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FOREWORD 



Most appropriately for a twentieth anniversary, the 1956 Invitational 
Conference on Testing Problems had as its theme "Testing — Then and 
Now." The speeches and discussions that follow are eloquent testimony 
to the great progress that has been made over the past few decades in 
such important areas as intelligence, achievement, and personality ap- 
praisal. One can hopefully dream that 20 years from now we will be 
able to look back to as great a measure of accomplishment as reported 
at this meeting. 

For the success of the 1956 Conference we are sincerely indebted to 
Chairman Irving Lorge. His imagination and energy, coupled with his 
sense of humor, did much to make the Conference instructive and 
enjoyable. To him and to the speakers I would like to say, sincerely, 
"Thank you.'' 

Henry Chauncey 
President 
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PREFACE 



The 1956 Invitational Conference on Testing Problems, sponsored by 
I'klucational Testing Service, was held at the Hotel Roosevelt in New 
^'ork City on November 3. 1956. This, the twentieth Conference of the 
series, was attended by more than 550 educators, psychologists, and 
jx-rsoiinel workers concerned with measurement and evaluation. 

The Conference was organized around the theme '* Testing — Then 
inid Now" on the assumption that psychonietry could afford a retro- 
sp<M:tive lo<jk to its origins and a forward look to its future. 

The I89()'s wt-re the years of beginning; Bine* and Simon's work on 
th*' nieasuremeiit of intelligence, and Joseph Mayer Rice's rejection of 
the concept that the elemeniary curriculum nmst be accepted as an 
invariant "given. * Indeed, for tlie United States, the 1890's saw the 
start of the expansion of educational opportunity for all the children 
with its intrvi table eonsecjuent that the e^ducational expectations for 
rliildren would depend on the calibre of the child. 

Intelligence testing in the I'nitcd States was accelerated not only by 
Tennan's Stanford Revision of the Binet Simon Intelligence Scale but 
also by ih*,' usi' of Army Kxamination Alpha during World War I and 
its subs(Hiuent utilization in civilian testing. Indeed. Jones and Conrad's 
geiierali/ations about the curve of intelligence was based on the use of 
Army .Mplia with adult civilians. 

The testing movement expanded rapidly in the 1920's. The objectives 
of the curriculum were ciiallenged by the psyclionietrists and their test 
results, as exemplified by Learned and Wood's rcxionsideration of the 
meaning of knowledge as wcW as the testing of the acquisition of general 
education whctluT obtained formally in s<^'liool or informally from the 
candidate's experiences and trans;ictions with his physical and social 
environment. Indeed, the Pennsylvania study indicated the need for 
a ( !iM>perative Test Service which in due course became (Mie of the roots 
of Kdncational T<*sling Service. The Conference* was fortunate in having 
Ren I). WcxkI review origins of the testing movement in light of liis 
personal participation with it. 

In the area of intelligence testing. Nancy Bayley integrated the re- 
search that reassessed the earlier concepts of the nature of intelKvtual 
i^rtiw th and decline: Tlielma Thnrstone. t(K>. brought n(*w evidenct; about 
the difference in the rates of the a<:liiev(Mnent of intellectual primes for 
the primary mental abilities. 

For pers*>nality appraised. Gardrier Murphy gav<; a fresh orientation 
to the iield. and Morris Krugman showed the relation between the 
newer concepts of personality and current methods of apprais<d. 
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In achievement testing. Ralph Tyler reviewed the approaches to 
curriculum then and now; John Dobbin reported on the newest measure- 
ments of achievement in today's schools, and Louis Hacker showed the 
need for appraising the ability and achievement of adults who are profit- 
ing from the opportunities to obtain a college education after work hours 
and after a hiatus in their educational progress. 

I wish to express ray appreciation to the speakers for their contribu- 
tions, to the stimulating extension of ideas by the many able discussants, 
and to Educational Testing Service for its odncational leadership in the 
sponsorship of Educational Conferences, then and now and in the 
years to corae. 

Irving Lorgk 
Cliairman 
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A New Look at the 
Curve of Intelligence 



NANCY BAYLEY 



In tlie past 30 years the accepted form of the age curve of intelligence 
has become pretty well stabilized, as the result of a number of studies 
in which many people of different ages were tested. Miles (25) set ihe 
pattern which follows the course of increasing scores to the early 20*3 
followed by a consistent but slower decline throughout the adult years. 
Subsequent studies have followed this pattern with minor variations. 
Notable among them are the studies of Jones and Conrad (19), of 
Wechsler (41), and of Foulds and Raven (11). 

In recent years repeated tests on the same persons as they grow older 
have yielded scores that do not follow this pattern, but indicate that 
at least some intellectual abilities may continue to increase slowly to 
50 years of age or older. These, among other findings on early develop- 
ment, such as the instability of infant scores, are forcing us to reconsider 
the whole subject of age changes in intellectual abilities. As a part of 
this reconsideration we need to review the methods by which intelligence 
can best be tested and evaluated, at different ages and levels of com- 
plexity. We must investigate the limitations of current tests and develop 
more adequate and discriminating ones. 

The Complex Nature of Inlelleclual Abililies 

It is, of course, understcxxi that the "curve of intelligence*' is derived 
from performances on tests that measure samples of the whole range 
and variety of mental abilities. This means that all of the following 
discnission presupposes that the tests must be validated and re-validated, 
as occasion requires and permits, against useful outside criteria of 
intelligent behavior. That is, if we wish to know the nature of intel- 
lec tual change over time, we must insure that we are using a valid 
measure of intelligence. It may be necessary, also, for us to re-evalunte 
our criteria of intelligence. 

In formulating any adequate theory of the nature of intelligence it 
strms to me necessary to take into consideration the fact that the 
Innnan organism, in all of its aspects, undergoes continual processes of 
change throughout its life span. These changes are more rapid at some 
peri(xls of life than at others, and in some processes than in others. They 

Li 
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involve increments and decrements in size and waxing and waning of 
functions. They also involve developmental increases in complexity, 
and processes of maturation of both structure and function, followed 
eventually by retrogressions, declines and other manifestations of 
senescence. 

In the field of intelligence these processes are complex and difficult 
to work with, and hence have been only partially mapped out. For one 
thing, the concept of intelligence is very general, and rovers a variety 
of intellectual functionings. It is necessary, then, for an adequate ap- 
praisal of the course of intelligence from birth to old age, that we con- 
sider not only the course of general intelligence, but also age changes 
in mental organization, and that we try to identify and independently 
to measure the various intellectual functions. When this has been done, 
it will become possible to trace the developmental changes in each 
function or factor, and to see how each fits in to any general, over-all 
curve. 

Of course, many investigators have been working on the problem of 
analyzing intelligence into its component parts. Early in the history of 
intelligence testing efforts were made both to define intelligence and 
to construct tests that would sample and score separately its different 
aspects. At first the various intellectual faculties to be tested were 
selected on an a priori basis. But with experience, and the help of 
statistics, we have found ways of isolating and measuring relatively 
discrete intellectual functions. 

Considerable work has been done on what seems to me the logical 
approach to building new test batteries, i.e., through the use of such 
methods as factor analysis, cluster analysis, or analysis of variance. 
But very few investigators have actually applied the results of such 
analyses to construct factorially independent scales. A notable excep- 
tion, of course, is the series of Thurstone tests of Primary Mental 
Abilities (39). Following from such a start as this, by successive con- 
structions, analyses, and additions of test items and test areas, we can 
hope to tease apart and thus to identify, measure, and label the different 
components of intelligence. Something very like this process has been 
reported recently by Guilford (14) who presents an elaborate scheme for 
what he calls **The Structure of Intellect.'' He reports systematic at- 
tempts to detect and to organize into a conceptual frame the various 
factors of intellect. With this schema as a basis, new types of function 
are hypothesized or identified, and appropriate tests are devised to 
measure them. It seems to me that Guilford reports the kind of research 
we badly imnl if we are to differentiate and understand the various 
intellectual processes that make up ^Intelligence/* But in his elaborate 
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analysis he does not take into consideration the further complications 
of age and inaturalional dilTerences. 

However, a number of investigators are interested in this develop- 
mental aspect of intelligence, and with the instruments available several 
studies have been made on age changes in intellectual ability and in 
mental organization (13). Much of this work has been done on tests of 
(Toss-sertional samples: that is, on tests administered once to persons 
of (lifferent ages. But there are very pertinent data now available from 
a number of longitudinal studies in which the same persons have been 
tested repeatedly as they grew older. None of these longitudinal studies 
covers the entire age span, but some start as young as one month of 
age and others continue through 50 years and even older. By splicing 
together some of these data it should be possible to construct longitudinal 
age curves of several dillerent intellectual factors. 

A Suggested Age-Curve of Inlelligence 

Any curve of iiitt'lligence will be dependent upon the behavioral 
components included in the test scores on which it is constructed. The 
general curve which I presented last year in an article "On the Growth 
of Intelligence" (6). is based on total scores of fairly comprehensive 
tests. To the extent that these tests are broadly inclusive and repre- 
sentative of "general inlelligence," this curve might be thought of as 
representing the usual course of age changes in general intellectual 
capacity. 

Everyone agrees that intelligence grows throughout infancy and 
childhood, though with the accumulation of records we have had to 
move along (from a start at 13 years), the age at which growth was 
assumed to stop. As for the form of the childhood curve, minor differences 
from one investigator to another are probably related to differences in 
tests and sampling, but there is the further problem of constructing 
comparable units of growth. In the tentative curve I constructed, for 
the peri(xi one njonth to 2.5 years, I used the test scores of the Berkeley 
Crowth Study. It was necessary to splice together the scores from a 
ninnber of different tests by converting the scores into standard devi- 
ation units based on the mean and S.D. of the 16-year scale scores on 
the Weehsler-Bellevue Test. 

This part of th<' curve shows rapid acceleration in the first year and 
again a moderate acceleration between 8 and 10 years. After about 10 
yt»ars the rate slows tlown so that by 25 the increment is very gradual. 
Freeman and Flory's (12) curve, although based on units derived in a 
different way. is similar to the Berkeley Growth Study curve for the 
ages it covers. 8 to 17 years. According to tlie V.A.C.O. curve, there is 
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atcolerated gnfwXh between about 10 and 12 years. This is later than 
the Herkeley (iniwUi Study period of rapid growth. However, difTfjrent 
l<Hi(.s were used, and when the sublesU of the V.A.C.O. are considered, 
viivh has a dilFeiviit course of growth with difTereiit ages of greatest 
inrnTiient.' 

By fittinrc on to the Berkeley Growth Study curve, the curves of 
e ither Ow ens' lown data, or of the scores made on the Concept Mastery 
fi^l by the s^kius^s of T<Tman'8 Gifl<*d subjects, it was possible to con- 
struct » TiO year curve from just two longitudinal snnipl«?s. Rather than 
rh<Kis*» between iheni. I put bf/Ji adult studies onto the curve. Each 
one ( onlributes s<iniething that he other lacks. The Alpha test probably 
siiinph^ a wider variety of abiliues, but the Concept Mastery test offers 
more possibility of expansion into higher scores. Also, the Tennan study 
subj<'<*ts covered a sufficiently wide range of ages tested that it was 
rxjssible to plot approximate scores by age at 5-year inter>als from 20 
t<i 50 years. Thus from the Temian material it appears that a relatively 
greater prop<irtion < f this adult growth occurs between 20 and 25 years, 
with the subsequent increments ref'Uively smaller, and constant. 

Of eonrs4\ this ciirv|. ran be viewed only as a tentative one based on 
iimit*^ tests and limited siunplt^i. In constructing more adequate cur>'es 
we nml to take into account many things. For example, different mental 
functions ap[)ear to have different rattn* of growth with different ages 
at mnximai contribution to the total. In onlcr to s|h?1I this out we nml 
to have hAl\ more clearly defintxl and more ad<Hiuately measurixl sub- 
t<»sts or "factors. " 

Changing ( '.m\p<menis of Ihe Citrvf 
It s#vms to me probable that in the early part of the curve the in 
dep<»ndent factors tend to occur successively, with simultaneously de- 
veloping and operating factors appearing only after some complexity <if 
intellectual functioning hps been achieved. For example, in the Berkeley 
( Growth Study both the enrly age trends in sUmdard deviations, and the 
>Mit terns of correlations for consistency of scores, indicate age changes 
in the nature of abilities. Thtnw* chnng<-s are nfso shown by llofstaetter's 
15 1 factor analysis of my table of correlations for consistency of scores 
from birth through 18 years (2). He obtained 3 distinct factors that 
ofH-rate HiirK-isively. first, which he named S<»nsr)ry-.Motor Alert. 
tu^H. in pnthMhinant for th»» first two years, with a very high heading at 
months 7 through 12. The .second factor, "Persistence" is high from 

•It w itil»MT^IiM|p t4» notf that lh»' rhiUhiMni p»THid of iin-» l» riilioH iti of ttf ^o 
*lin r*»ni.*H ftr/.T.* thf «iJol*^-,.fil ^piirt of phyui nl KJ -m Ih in N.y*. For thr iVrk. l. v 
MiMly il in^ MV^ in iN.lh ^\r^ At tlir virw fk^ hxm\ is uv»-r twTorr i^hyHiral anf L rHtiun 
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2 Id 1 y< cirs. while ihe third. "Maiiipulaliiig Synifxils ' accounts for 
most f>f lh«* variance after 4 years Tho three factors arc about c<|nal 
in wrii^'hl at two yrars. 

This UM- of the total scores gives evidence for some agc-s|n»< ilic factors 
aiuJ r\rii indicates lh«* bcj^nninpi of concurrent factors that operate 
*»vcr lon;;rr sr^^nicnls of growth. The total scores arc made up from a 
>aririy of behaviors which could represent several different factors. 
SupjMjrt for only general factors in infancy is lent by the study of 
hichards and Nels<in (31) who factored the Gescli Scale scores for 80 
infants at 6, 12 and 18 months. In this scale they included gross motor 
c<M inJiiial ions that are left out of the California First-year Mental Scale, 
The fact that tlicy obtained just two factors, **Alerlness" and "Motor 
\bilily" would niak«* it app<»ar that I had already separated the fac- 
lorially indefM'ndcnl functions in the lirst year by putting the gross 
motor coordinations into a Scale of Motor Ability. Therefore, the 
"Si nsory Motor Alertness" factor of llofstaetter and the ".\lertness" 
factor of Hichards and .\eLion appear to be practically identical. This 
fat lor mn\ very well represent the lion's share of **intelligencc** for the 
lirsi *) months. After this !Iofstaetter*s factors II and III appear to be 
«»p< ralin<: concurrently for a while. 

I shall not attempt to cover the work on factor analysis of intelligence 
li sts. Then are otlM-rs hen* fi^.r more able to do this. But it may be of 
inte rest to consider a few isolatt^ bits from longitudinal studies that 
it MM-rns to nie contributi* to our understanding of this general problem. 

Freeman and Flory's (12) longitudinal data show different slopes of 
ln<Tement for their four subtests and evidence for different ages at 
higlu^sl ability. Helativr to the means and S.D.'s of the 17-year scores 
Um' Analogies More has shown m*»st change during the 9-year 
int« rval. U to 17 yiars. with Oppositcs scores gaining wrond. Tin- 
slop<»s of thise curvtN indicate that they have approfichcd close to their 
mature status. The slow«T-gaining V^xabulary and Completion tests 
a|)fM*ar to Iw still gaining at 17 years (1). 

S»m«- ilata Imis«*<I on re test scores on the Wcchsler-Bellevue for my 
small Berkeley (Irowth Study sample may be relevant in this same 
conmM-tion. This was given at four ages (16, 18. 21 and 25 years), 
the mimb^T for the first three testings ranging from 35 to 45. So far. 2% 
have iKM'n given the test at 25 years. For the full scale and for the Verbal 
and INTfomiance halv es, there is no indication that these young adults 
have reachi"*! their intellectual ceiling. But for this group, the subt'*^t» 
of tin- Wei hsler-B« l/.', vur ^f.*^ unequal both in difficulty and in the s\o\ 
of their age curvr-^ Ai. F.a* d) appears to be following a different course 
ii{ change w ith age i (tn^r dilf'^rences show up most clearly when constant 

// 



16 



1936 INVITATIONAL CONFKHKNCK 



subwimples are fWflwt«-<J, so thai the siiiik* cas<-s are iiu-liidrKl al all ngwj 
u.sed ill the growth curves. 

OUn-r subsampK^s, si'lcclccl (o Im' horiiof;enpous in c<Tlaiii respects, 
show intert»stiiig difr<T<-iw<»s in scores and growth rates. For example, 
in a division by sexes boys and girls do alxnit e<iually well on the Full 
Scale but tlie boys are b^'tler on the \ erljal, and the girls on the Per- 
formance Scale, 

The gronp was divided into hij^her and lower inlclligciire halves on 
the basis of their average siurva at 16, 17 aiid 18 years. The highly 
intelligent group was found to do efjually w<'ll on th(? \ erbal and Per- 
fonnance p^irts of the test. The lower-scoring h-ss "iutelligent" half, 
however, dw^s nuicli h^ss well on the Verbal than on thr Performance 
Sale. Hotli highs and lows exhibit increasing .scores Imf with some 
indication that the high group is approa< hing a ceiling, 'i his ceiling is 
at h ast in part dtie to a lack of top in the M 'rhsler-liellevue s^ ale. 

If we consid<T the 11 subli-sts separately, /or constant sub-samples, 
the greater dilFereiicrs betwet-n the higher and the lower intelligence 
groups iN Cur in the iy vrrbal tests, .\iuong the 5 Performance tests the 
two groups dillVr most in Pirture Arrangement and Hlix k Design (tests 
that ref|uin» organizalion of spatial relations) and least in Pi< i -jre Com- 
pletion and Digit Svadw)! substitution it<sts that n^iuire rtrognition 
of patterns). Those subtf^ts in which thr ))i'?hs do not show confinu<»<l 
iiierease in scores are tests in whi<'h they have already reached the 
upt^er limits of the si-ale. The lows show continu<Kl growth in most 
subtests but app<-ar to have reached their top capacities in the Vocabu- 
lary and HliK k Desigii subtests, and i>ossibly Picture Arrangement. We 
may hav(» here some indications of dilFercntial gnjwth according to 
level of :d»ilit>. 

Tla^e comparisons are on a vtry small siunple, and on n test that 
is not comph'tely a(l(-<|uat(* for such purposes. The data therefore are 
<»nly suggestive, but tht»y do seem to indicate some probiible dilTercnces 
in ability-tifMl growth rates for diirerent intellectual fuiu tions. However, 
cn'<Jence may l>t; h-nt to these difT<TeiH*<»s by the faj-t that they are in 
general congruent with those found by H. K. Jones for the Adolescent 
tirowth Study for a simihir age range on the subtests of the Tennan 
( iroup test ( 18). 

To carry the picture lieyond 25 years we may turn to the I'on.sidera- 
tion of age cliang*»s in l)oth rross-s<*ctional and longitudinal studies. 

The (Toss-siH-tional studit^ tend to agree in the firiding that scjine 
abilities, sueh as infonnation and word knowledge, are maiiitain«Hl with 
little or nt> h>s8 to an advanct^ age, while other abilities such as arith- 
nieti<\ analogi^'s, and organization of spiitial relations, diH:line with age 
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(after 20 or 30) ut vuryiiig rates (17). Those functions that drop off most 
rapidly in the older subji^cts appear to dilFer with the tests iis<nl. and 
to some extent with the populations studitnl. The more recvnt the 
studies and the more roinplete the population sample included, the less 
do scorrs drop with advancing a^^e. Other dilFerences in age trends are 
often found to be ri»lat<?d to general intellectual level of the subjects and 
to the amount of their education. 

In the longitudinal studies, however, there is an invariable findin)2j 
that the scores in at least sonir subtests are higher on the secoiiiJ testing. 
'I'h«» r'arlier of these reports, such as the studies of Freeman and Fhjry 
(12), and of U. L. Tliorndike (38), wi-re usually on tests of young adults, 
mostly eolli'ge students in their late teens and early twenties. Mi it more 
nrei»lly repeat test scores have been secured on adults at later ages. 
These also show im-reased sc(»res earnwJ at the later testing after the 
subjects liave gr^nMi older, with 12 to 30 years elapsed time between 
tests. I should like here to suimnari/e some of these studies. 

Owens (27) repeate(J the Army .Mpha test on llfly-year old men who 
ha(J taken this s^ime lest thirty-one yisirs before as c<»llege freshmen, and 
fouiKJ an inrr(»ase in Irsted ability at the later age, with greatest increase 
in the Infornuilioii test, and least in Arithmetic. I^ayley ana Oden (7) 
found increases on repeal tesis after a 12-year interval, for gifl<'d adults 
on Termaii's (lilFieult ('onrept Masl(Ty test (3 )). W hen these si-ores are 
e\presse(J in Standard Deviation units f<jr each subtest at its initial 
a(]mitiis( ration, there was twice as imich increase in the Synonym- 
Anton vm (or word-knowledge) half as in the Analogies (or abstract 
relationships) half of the lest. The increases occur in all age groups 
testinl (20 to .">0 years), though they are least in the Analogies test for 
the older ages. Nisbet (26) reports repeat tests after a lapse of aliout 
23 years, on 141 teachers in Aberdeen. Scotland, who were first tested 
as |H)st-graduate students when about 22 years old. On a timed verbal 
group test (Simplex Group Inlelligeuee S<'ale) improvement occurred 
on all I i subtests*, the increase was signiiieant in all but one. Greatest 
increases, eXf)ress«*<J in S.D. of tin- lirsl l*»sting. wi're in Substitution. 
.71 fT. Vocabulary. .67 c, and Number Series. .6.") (t\ they were least in 
Digit Memory. .16 t. Verbid Uearrangemenl. .21 (t. and Analogies. 
.26 (T. ii. K. Joiios (18) has rejxjrliHj iniTca.sed l\'rman (injiip Test scores 
between the 16H year tests aiuJ relesis at 33 years for 83 cn.ses of the 
lierkeley A(Joles4*ent Growth StU(Jy. lie foun<l .smaller gains in the 
low*»st-scoring (juartile ofhi.s population and in those subtests involving 
probleni-Mjlving. The greatest gains were in \'(M-abulary. 

Tluis. the studies cited. U>tli tlie cros.s-scctional and the longitudinal, 
show similar age lreu(N in eliatiging organization. At the older ages the 
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suhjVcts d(i relalivply belter in t<^ts of information and word knowledge 
and IrsH well in tests of rea^ioning and seein;,^ relationships. 

Evaluating Intellectual Changes in Adults 

The difference I>etween the two methods of study is found in com- 
parisons of the actual scores. In the longitudinal studies the subjects 
ni-arly always do better at the later testing, when they are older, on 
most of the snbtests, as w ell as on total scores. Although the longitudinal 
stndies were made on different populations and using diflcrent tests, 
they agree in finding that different intellectual functions show varying 
amounts of increase, ranging from no change to as much as a standard 
deviation l)etwecn test and rctcst. In no instance do these studies show 
the precipitous drrline in scon»s after the fige 25 to 30 that occurs in 
most (Toss-sectional studies of agt; differences. 

Let ns consider some of the things that could ateonnt for this difference. 

(a) When subjects of different ages are testtnl at one time, there is 
the problem of selecting comparable sampltrs. Apparent changes in 
relative s^'ores could be artefacts of differential Siunple selection for 
subjects of difTerent ages. In the older age groups there may be selective 
elimination of certain segments of the population, through deaths or 
through lack of cooperation. It is true that when a complete population 
is testt»d, e.g., a whole Vermont connn unity (19) or an entire prison 
population (9), the curve of intelligenee scores shows less decline with 
a<:e. We might com lude that when willingness to be tested is a selective 
factor the brighter older persons are less cooperative about taking tests 
or else more adept at finding excuses. In any event, when the same 
persons ari! retest<»d at successive ages, whatever the selective factors 
in sxmiplijig, we do have a constant s^nnple. 

(b) Hut with a constant sample then? is the ever-present problem in 
psychological testing, the inescapable fact that a test is never the same 
for a person the s<»cond time he takes it. When comparing re tests it is 
neci'ssiiry to take into account possible practice effects and generally 
increase-' 1 familiarity with the testing procedures. However, in many 
studies practice (»fr(H:t.s are of little import. W^hen the elapscil time 
betwi^en tests has been as much as 12 to 30 years (as in the Owens, the 
Mshet, and the Hayley and Oden studies), it seems obvious that there 
can be very little, if any, direct memory of problems and their solutions 
from the first to the second test. Also, when alternate test forms are 
uswJ there may be very little increase after short intervals. I have, for 
example, some data on practice efTects of the Concept Mastery test. 
There was prnctieally no carry-over from one form to the other after 
an interval of only 1 or 2 wet»ks for the sample of 148 on which the 2 
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forms of the scahj were e(|iiated. The difTerence was less than two points 
or about 1/ 15 of the S.D. of scores. 

(c) Another important difTerence between the longitudinal and cross- 
sectional data is the temjxjral one. Perhaps llus has not been given enough 
weight. Ill cross-sectional studies all t ^Jits are given at the same time, 
while in longitudinal studies not only do vane subjects grow older 
before their retests, but wilh the lapse of lime liiey have all experiencwl 
the sanif* gr-neral chanp's in the cnvironnient, ami have been responding 
to sirnili^r changes in such things as world events and means of com- 
munication. 

It is relevant here Ici point out that th<; scores earned on the Concept 
Mastery test by Tennan's fiift^xl Study subjects who were tested only 
once increased jnst as nmrh in the 12-year interval, 1039-40 to 1950-52, 
as did the scores of the twire-tested subjects. One hundred-twenty-nine 
of the men who niissrd Ihe lirst adniinislralion of the lest hut took it 
in 1950-52 eurm^i M^orrs avi'ra^'ing half an S.i). alxjve the mean for the 
men U^UhI in i9:j0. A similar iru rease over the 19:J9 means was found 
for 98 (lifted Shidy women who were lirsl tested in J950-52. For each 
testing dale ihe means of ihe onre-lrsh d and twice-tested groups are 
very similar. Thus, there appears to have been no selective factor 
dilFeriMi tin ling the groups: whether or not a snbjtvt was lested in J939 
and/or 1951 Wiis pretty nujeh a matter of his geographical availability. 
Furthermore, for lliese bright people the average scores earned at the 
hiter date and older age were evidently not dependent on the experience 
of having taken ihir Concept Mastery test at the earlier date. In genernk 
then, it seems (o nn that we s! ould consider very seriously tla? pos- 
sibility that at least some kinds of intelligence may very well continue 
to improve shiwiy from 20 to 50 years or older. 

i'^nrlronmenlal Deierminrrs in I ntellertnnl Growth 
So far i have louehed only briefly on the whole array of potential 
inllnenees on inlellec tual growlh that we may classify as environmental. 
This is a very general lerm, including both emotional climate and 
op[M>rtunities for inti'llectnal slinndalion and for practice in intellectual 
activities such as reasoning and problem .sf»lving. No organism develojjs 
in ( ompl"le ab.sence of slinmlation. and up lo a certain stage in infancy 
the minimal re<piiremenls for life furnish adt'tpinte stinmli to alford 
normal development. Ordinarily the human infant\s environment is 
nmeh richer than these minimal conditions. The infant responds to 
tho.se parts of his environment that are relevant for his degree of nia- 
lurily fnenrah sensory-mo!-.r. perceptual and organizational). Al.so, as 
he grows the aclively h a)th> child w ill inleract with his surroundings. 
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sookiiig stimulation to the extent of his capacities to utilize and cope 
with it. Those who are inherently gifted may well be the ones who con- 
tinue to seek out and to find challenging intellectual problems and 
experiences in any normal life situation. However, there are probably 
here also inherent individual differences in this kind of active intellectual 
curiosity. Granting this, we may further explore the possibility that 
extreme environmental deprivation, or depressing emotional climate 
could restrict the growth of even the most intellectually alert, while 
optimal intellectual stimulation and emotional climate could enhance 
the development even of those with little inherent drive or capacity. 

If we assmue the relevance of these variables to the growth of in- 
telligence, Iheit we need to study the conditions of their effects on the 
f'fMirse of menial development. We should inquire what kinds of emo- 
tional tlimale are optimal at what ages, what effects the attitudes of 
responsible a<iulls such as parents and teachers have on intelligence, 
and whether certain attitudes are more important at some ages than 
at others. We should inquire further: What kinds of intellectual stimu- 
lation, ur •'eiiviroimiental enrichment'' are optimal for infants, pre- 
s<h(M)hTs. children, adults.^ Is deprivation at certain stages crucial in 
determining whether development will be normal? That is, are there 
environmental "critical stages ' for mental growth analogous to those 
einbr>ol(»gical stages at which trauma can result in such deformities 
as cleft palate, ovarian agenesis, or possibly Mongolism and other 
conditions sscKialtxl with feeblemindedness.^ 

We havi: now some relevant information, offering tentative answers 
to s(Mne of these questions, but .so far most of the information is based 
iin <:isnal observations or on studies that have not been sufficiently 
well designed and controlled to [rive us definitive answers. 

A tumiher of reiM>rts f8. 3t) suggest the retarding effect on infants of 
life in institutions which offer little in either normal parental care or 
mental stimulation. Uut we do not yet know either the amount vr 
geiu'rality of this effect, or on the other liaiul, what are the crucial aspects 
in regard to type (if care. lh<» nature of deprivation, or the ages at which 
the child exiH-riences them. The fact that institutions do not invariably 
depress iidelligence is brought out by Rheingold (29) who studied the 
effects of a significant caretaking mother-figure on 6-month old institu- 
tional babies. The six babies she cared for 40 hours a week for 8 weeks, 
coinpared w Uh 6 c(»iitrol babies, showed no significant differences in IQ 
at the end of care. 

There are studies that show significantly low IQ's for children in 
backward rural connnmiities CH, 12). The studies of racial differences 
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ill intelligence are plagued with the problems of environmental im- 
poverishment in certiiin racial groups. 

The many comparisons that show a correlation between socio- 
economic factors and IQ have made clear the fact of the relationship, 
but give little information about the specific ways in which such factors 
might efTect mental growth. 

Studies of the relation between intelligence scores and such person- 
ality factors as emotional tone, effort, and persistence, usually show a 
moderate positive correlation in young children. But so far wt have 
little information on the effect of long-term emotional influences on 
the growth curve of intelligence. However, we do have reports of the 
differential efft^cls of praise and blame on learning, and the depressive 
effect of anxiety on achievement in school (28). Ability to learn is often 
clnsstni as one form of intelligence. 

In the Berkeley Growth Study (5) as well as in other studies, such 
Ihings as the cliiluren's emotional tone and generally optimal conditions 
for testing yirld rs with IQ that are in the neighborhood of about .30 
(21. 16, 43). However, when we considered ii:dividual children, and for 
eat-h child C(irrelat<-<1 his "Optimal" and "Attitude" scores with his 
intelligence rulings for series of 10 to 15 iiges we found a wide spread 
of r s from +.77 to —.46, with a mean of +.20. Evidently the children 
differed in the effect of current emotional state on performance, and 
iV.r some children other factors (presumably maturational and heredi- 
tary) were of predominant importance for mental growth (5). 

As for the long-term effects of emotional climate, Schaefer, Bell and I 
are now in the prcx^ess of getting some tentative inff)rinati(in from the 
lirrkeley (Irowth Study (32). Personality characteristics of the mothers, 
n lrvant to Ihrir brliavior toward these cliildnMi, have been rated. The 
ratings were made on a scale desigiunl for use with descriptive protocols 
of the mothers, made at the times they can^e with their children for the 
tests whc!i the children were between 1 month and 3 years of age. Some 
of tlH»se behavior traits were found to be relatively stable over a lO-year 
period that could be compared. The most stable of the niaternal traits 
are: c(Kiperati\ riiess, use of it^ar to oontrol the child, irritability, ten- 
dencies to igiiore the child, to rej<x:t the liomemaking role, to evaluate 
the child p<jsitively, to express affection toward the child, to treat him 
as an equal, and to be strict with him. The 32 traits could be clustered 
into two main variables, which we have labeled by the "good" end of 
the scale, (a) Positive Attitudes, and (b) Autonomy of the Chi/d. The 
few correlations we have computed with intelligence indicate that there 
are relations with these maternal variables, but that the nature of the 
relationsliip changes with the age of the child. If these preliminary 
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findinpjs should hold up, it would appear that during the first year of 
life higher scores tend to be earned by babies whose mothers are in- 
trusive, dominating and punitive, while by the time they reach school 
age the reverse is true and the high-scorers' mothers are characterized 
as Cfxiperative, evaluating their children positively, expressing afleclion 
toward them, and allowing them aulonoiiiy as individuals. 

This analysis is still so incomplete that I hesitate to mention it. But 
th ere are other studies that corroborate it in a general way, though they 
are not directly comparabltj in methods or in the variables used. For 
example, Macfarlane, Alh*n and llonzik (24) report correlations between 
ehildren's mental test scores and the number of their problems (as 
reported by the mothers). At 21 months and 3 years the r's with IQ 
tend to be p<jsitive, but from 4 tlirou^rli 14, the r's are negative (around 
- .HO), indicating a tendency after 3 years for high IQ to go with fewer 
problems. There are no direct correlations reported here between the 
IQ*s and parental attitudes. However, in another paper (16) the same 
anthors report individual cases whosv IQ's appear to be related to 
parental behaviors. Wittenborn (43), working on data from the Yale 
Clinic of Child Developn^vnt, reports some rs between 5-year Binet IQ 
and certain chorarteristics of adoptive parents. These r's also vary 
around .30. with the adoptive parents' Ambition, Kdueation-Occupation. 
and Ajiji'-DuratioM of marriage. Tli<»se variables probably reilect some 
endnring attitudes and expectations of the parents. 

If we were to develop an cnvirornnental criterion of conditions foster- 
ing hi«rli intelligence, it might be composed of s<M)res on some of the 
following variables: 1. Characteristics of the parents (or responsible 
adnlts) in r(\spect to: (a) Cndtirstamiing of the child's capacities and 
readintss for tasks of given diilicnities, (b) willingness to grant the 
• hild antonomy relative to his capacities, (c) ability to offer st- lulatin,*^' 
expcrirriccs without overly strong pressures to high achievement, (d) 
warm allVclionate iicceplnncc of child as an individual in his own right. 
2. l\nvironrnr'ntal opportunities geared to the child's stage of develop- 
ment. These hi.st will include go<Ki teaching and varieties of experien<'c. 
perhaps through the media of such things as radio and television, a^ 
wi'll as (ravel, nnd discussions of ideas. 

Wechsler ( tO) has rec ently dis(russ<Hl the possible cau.^^es of the <iir- 
ferenccs bc»twcen the 1939 and 1955 age-cnrves of intelligence as meas- 
iinnl by the two forms of his scale. The 19.55 curve is at most ages higher 
than the earlier one, and scores do not start to drop until after 30 years. 
In addition to the usual reasons (.sampling, educational level and test- 
wisenesvs) for this generally increa.swi perfornnnice, he offers a fourth 
of a very different kind. To (juote from his abstract: "Finally, one may 
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posit tliJit the improved perfonnjince of the American adult on tt'sts of 
iiitdhgcnce could be due in part to the improving general health arid 
virility of the population during the last two decades. Advances in 
inrdical and social liypene have seemingly not only served to increase 
life expectancy but extended the period of intellectual as well as physical 
vigor into later maturity/' 

\\c find sorne support for this suggestion of Wechsler's IVorn studies 
of childreirs ruitrilional status. Many studies report low positive rs 
with IQ of such variables as si/e, health and physical maturity (10, 20. 

It V therefore, quite possible that generally improved health and 
living c«>nditions in recent years arc rellected, not only in generally 
greater physical size, but also in greater and more prolonged mental 
vigor. 

I should like to suggest to Wechsler that he go n step further, and it 
liis hypothesis is true, then possibly his curve falls olF after 150 because, 
ill his t ross-soetion sample, his older subjects have not had the a(Ivantage 
of growing up in this generally more healthful world. 

Another step beyond this is to suggest that not only is the physical 
er;vin)nnient improved in the last two decades but also the psychological 
enviruiiment. Perhaps in addition to more years of schooling for more 
!• uph' we have actually progressed in our educational L'lTectiveness. 
;:r:nle lor grade. Also, it seems rather obvious that the general environ- 
iijent in which childn'ii are now growing up is richer: there is more 
knowledge available and better communication of it; travel is easier, 
and more children can, with less trouble, have varied expiTiences. 
possibly also our knowledge of child training and mental hygiene are 
inlhiencing parental practices in a healthful way. 

If these things are true in any significant degree, and if progress in 
mental and physical health continues, it may become necessary re- 
peatedly to construct new norms for intelligence every decade or so. 
Furthermore, in considering age changes in older people, we may need 
to evaluate their scores according to norms standardized at appropriate 
calendar years, rather than for age only. 
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Implications for Test Construction 



TIIELMA G. THURSTONE 



Studies of the growth of human intelligence are of interest and 
importance for two fields. The first of these is the general theoretical 
psychological problem of how intelligence develops throughout the 
entire life span, and the second concerns the implications oC the scientific 
findings for application in all of the fields in which intelligence tests are 
used. It is the purpose of this paper to report the findings of several 
studies on the growth of the separate mental abilities and to try to 
make some suggestions for their application in test construction. 

Dr. Nancy Bayley*s paper in the American Psychologisl for 1955 
presented an excellent summary of the findings of a large number of 
studies of the growth of intelligence. Most of the studies were done at 
Berkeley and represent work with individual testing of people of all 
ages. Dr. Bay ley's paper which was just referred to, contains a note of 
dissatisfaction. This is not surprising because she set herself an extremely 
difficult task to study intelligence from birth or even conception through 
senescence. Though the data on which some of the conclusions are based 
were not satisfactory to the author, I think that we must all admire the 
extension of her thinking beyond the actual data. It is from this kind 
of thinking that we shall discover new ways of attacking the problem 
of the growth of intelligence in the age ranges where it has been most 
difficult to study, that is, the earliest years of life and the last years 
of life. 

In this paper I shall restrict my comments to a much narrower age 
range and perhaps a narrower subject. Specifically, I shall refer to the 
nieasurenjont of primary mental abilities or factors of intelligence. So 
fur the studies in this field have been concerned with children of school 
age and early adult life and have been based almost entirely on group 
tests. This does not mean that we have not been interested in the 
problem of measuring intelligence at the early ages and the later ages 
but simply that we have not had suitable tests foir the youngest years 
nor tests nor time for the later years. Perhaps lliofe is some justification 
other than the ease in approaching the problem for having confined our 
studies to the school age range. It is in the schools and in the mifitary 
service and employment where we find the greatest application of the 
results of test construction. 

A first area of study in which the results of studies of intelligence at 
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various a^'o levels have some implication for lest construction is in the 
results of the factor analysis studies at these difl'erent ages. Factor 
analyses have been made of tlie results of administering large batteries 
of tests to large numbers of children from kindergarten age through 
early maturity, fn these attempts we have worked our way down 
hegiiming with the college age group, later working with liigli school 
cltildren, then with eighth grade children, and somewhat later with 
kind(»rgarlen and llrst grade children. One of the most interesting 
results of all of those studies was that similar factor patterns of abilities 
emerged in all of the studies. This finding has allowed a type of study 
(^f rates of mental grow th which was not possible when we were dealing 
with a composite or average score sucli as mental age or IQ, which were 
involved in earlier studies of patterns of mental growth. 

A related question concerns the pattern of abilities to be found among 
people of varying ability levels when age is constant. The study made 
by Bef:htold at [\n) Psychometric Laboratory at the University of 
(>hicago showed similar patterns of mental organization for groups of 
children varying widely in intelligence but who were all at the fourteen 
year age level. 

Tliis invariance in the factor pattern of abilities has very definite 
implications for the construction of intelligence tests and their use. 
It implies that we should be able to construct tests of the same abilities 
at the successive age lev(*ls in wliich we are interested. Certain limita- 
tions in the kind of group tests which can be administered to very yoni»g 
children who cannot yet read or write prevent a complete application 
of this principle. To be more specific, the word fiuency factor was 
clearly present among kindergarten and first grade children, but the 
use of group lesls of 1 1 lis ability at a very early age level has not been ac- 
complished yet. We have so far found no way to measure this ability 
except by giving the child a chance to write or to say words as fast as 
Ihj can. In the first case the young child cannot write fast enough to 
give us an indication of his fiuency, and in the second case we are 
turned back to the use of individual tests. Both for theoretical studies 
of the growth of int(*lligence and the development of fmther testing 
metluxls these individual t(»sts hav(* been used, but for any sort of 
practical use in the school the individual testing techniques have not 
yet received attention. 

A second area of research for the primary mcMital abilities involves a 
longer range predictive study of tests than is ordinarily made. The 
study which will be nienlioned here will be reported fully in a Psycho- 
metric Laboratory Heport in the near future. It is concerned with the 
correlations between the primary mental abilities scores of elementary 
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school children and their surceas in the school subjects of reading, 
spelling, and arithmetic. These achievement variables were selected 
because they were the ones which were available in the school records. 
The sludy was carried out partly because of a need to make a recom- 
mendation about the frequency at which testing needs to be done in 
the s< h(Xil situation and partly to decide how many levelsof group tests 
rufHl to hi' prepared for an adequate guidance program in the elemen- 
tary schtxjls. 

The dala for this study were obtained from about seven hundred 
rhildre^n in seven elementary schools in Chicago in the spring of 1932. 
At that time the primary mental abilities tests for lirst grade children 
\i,u{ hi'vii a standard part of the elementary school guidance program 
sinre the fall of 1916. This meant that the children who had enten*d 
lirst grade in 1916 were now in the sixth grade. The primary mental 
ahilitit's te st for the intenmnliate grades had been given in the fourth 
gradi' sinre the fall of 1919. This means that those fourth grade children 
who hiid twken the U*s{ in the fall of 1919 were in sixth grade. All of the 
ehildren whos4' records wiTe studied had taken the primar>' mental abili- 
tit's t<Nts in first grade and in fourth gnide and were now in the sixth grade. 
Ht-ading sf-on's for all these children were available for grades two 
throu^'h six. Spelling and arithmetic srf)res were somewhat harder to 
ohtaiii, but sp<'lling scores were available for s<jme children in grades 
four. live, and six whih- arithmetic .scores were available for most of 
tilt' children from grades tw(> through six. It is not the usual practice 
to administer arliievenient tests in the elementary schwls every year 
but for the purpose of this study, certain schools where tliat was the 
priu lin- vvi-re sele<'t**d. Thus we were able to study the correLition 
bi^twren total scortN on the intelligence tests and scores in the S(»parate 
jibilities fur five difTerent time intervals. We had anticipated that the 
rorn lations would drop marktKlIy with a hips*' hi time; that for example, 
the corri hitiou betwe«Mi the first ^rade intelligence t(*st scfire and reading 
in the S4'cond grad«' would be mticli higher than for the (Correlation 
between intelligence test scores in the first grade and reading scort*s of 
the s;ime chitdn^n in tin- sixth grade. It was ;i very surprising finding 
that then' was on tlie average no loss in pre<iiclive value of the test 
srf)re.s luit that actually there .seenH'<l to be a .slight rise. The correlation 
Ix'twetMl total test scores in the first grade and reading in the siTond 
grade was A2; the corre(uti(i»ii between total scores and reading for the 
saline intelligence test t^jken mi the first grade and reading scores in the 
^Ih grade was ..11; (r tak' another example, the cocfiicient of cor- 
relation Iw'tween sc<inv in the quantitiitive part of the first grade in- 
telligen«e tvni and S4'»()nd grade arithmetic scores was .31, while the 
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correlation between these same test scores and arithmetic test scores 
made in the sixth ^ade was .51. 

For the intelligence test which was given at the fourth grade level 
when the children were nine years old. we liave three years of achieve- 
ment test scores with which to compare them. The correlation between 
total st!ore an the intelligence test taken in the fourth grade and the 
reading test taken within two weeks of the same time was ..56; while 
the correlation between these test -ron-i and a reading tftst taken two 
years later when the children were in sixth grade was .61. For arithmetic 
te^ts and intelligence ttst scores the correlations rose from 39 to 67. To 
take a single one of the primary mental abilities' scon s, the correL.tion 
between tlie V\ verbal comprehension, score at the fourth grade level 
and reading, the c(jrrelatitjn was .71. Two years later the correlation 
between thesi- intelligence ti st scores and sixth grade reading sc-ores was 
.78. For spt-lling llie shift was from 61 to 71 and for arithmetic from 
:A to 60. The interpretation of this (onsistent although sligfit rise in 
the correlations b4Hween ihr >t s<:ore and achievement s<-ores over a 
pi riixl (jf time is difllcult. The conclusion that intelligence is a more 
important factor in later sch(K>l acliievenient than in early s<;hool 
achievement Ls suggested, but we cannot make a definite commitment 
uv this fM>int. However, it do^'s seem perfectly clear that there is a con- 
liijjity in the intelligence functions tested and that the early nuMSures 
;ire signilicant for a h)ng«;' period of time than we would have antiri- 
pattil. Tlie nsults give ns justification for believing that guidance of 
elementary sc hool children on the l,asis of tests is a continuous affair, 
that tt^sts Van b<» useful ihroughonl a wider time range than tliey once 
were I'onsiden^i lo be. For lest construction the implication is definitely 
snggesti'd that i( is worthwhile to try to construct the tests for the 
variiais age ran-rs whieh ha\r overlapping abilities. The tests for some 
age groups may contain hsls whieh are not present in others, but an 
ndetpjate guidance program srrnis to hr inipossil)le unless some of the 
same tests (M'cur conlimionsly throughout the age range. 

A third an a of investigation whieh thniws sonn- light on the problem 
under disc ussion is a study of difFen ntial rat<\s of gn)wtli of several of 
the primary nanlal abilities. We were fortunate to have data for 
Ihousiuids of cfiildren ( overing an age range fnim five to nineteen. 
Data were not availal>le for all children on all of tin- abililie-s, but the 
data wen- so exli nsive thai we wen- able to plo\ growth ciirve< f>n an 
al)sohjle sc ale for sevm of the primary menial abilities. Tlics<; have all 
iM^en describ»Hi elsewhen* and will l)e only meiilion«*d here. They are 
perceptual spe<Hl, space, nMMiiiing. nmnl)er ability, memory, verbal 
comprehension, and woni fhieney. The first n port on this study was 
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itiJide ill the spriiif? of 1951 and later published in Science by L, L. 
Thurstone, The seven curves plotted on the same chart show ver> clearly 
a diirerence in the rate of maturation of the separate abilities. We know, 
(if course, that all of the cibilities start from zero ability at approximately 
the sjime age. If we take 80% of adult performance as a criterion, we 
find that the perceptual speed factor reaches this criterion at the age of 
twelve years, maturing rather eaHy as compared with the other abiiitit*s. 
The reasf)ning factor and tfur space factor obtained about the san <• 
level of performance at thr uge of fourteen years. Rote memory and 
Munib<T ability reached the siime level at abfjut sixteen years. The 
verbal comprehension factor develops considerably more slowly and 
d(x's not reach this criterion until the age of eighteen. The word fluency 
factor matures even more slowly and lias not reached this criterion at 
ji^'e twenty. Remembering' the criterion chosen, 80% of the adult 
levi l, it is clear that c(jnsiderable growth takes place in all of the func- 
fioiis after Uie year levi ls ineiitioned here, 

A number of impli( ations for t(»st construction can be read from these 
n . suits. The first of these is that we should be able to construct tests of 
the several abilities at all of the age levels with which we are concerned 
in the age rang/- of scIkm)I children iiml early adult life. Certainly it is 
not (lillicult to lt^)k forward to the constrnction of tests of these same 
jibilitits at th.» more advanced age levels. So far as our growth curves 
have been determim^l, we have not yet found any indication of the age 
nl which the downward trrnd or decrement in any of the abilities may 
start. We know that it is there, but it .seems that for the present we must 
think of it as a question for experinit^ntal (leterminalion. At the other 
end of the age range, the very eariiest years, we shall have to look 
forward to the development of other teclini(|nes in measuring the primai^ 
mental abilities in order to extend the growth curve downward ex- 
periinent^illy. It is going to require considerable ingemiity in observa- 
rioii in the b^ lmvior of yonm: children and in ttvst coiistnw f ion to invent 
Ihf kinds of tisl itenis which will be appropri;it<» for measuring the 
primary mental abilities at the eariiest age levels. It is the conviction 
of this writer that sncli an attempt may not be so far away. 

So far we have dis4 iis.sed the implicjition of three experimen- 
tal studies for the construction of intelligence tests, (lerlain general 
implications shonld be disf iissed now. It .seems that although we feel 
that wi- have made progress in the im\'istirenient of intelligr'iice by 
jitialy/ing intelligence into a mimher of components and constructing 
li sts to measure tll(^s*» separately, we should l(K)k upon onr present tests 
as in nt^ed of eonsiderabh^ refmement, A few definite examples may be 
mentioned. In the earli<.»st factor study an abifity which w<' called per- 
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ceptual speed wa3 clearly identified. Liiter experiments with numerous 
tests which seemed to be related to this ability somewhat weakened 
our satisfaction and we found it necessary to make a very detailed study 
of the penvptiial abilili<'s, issuing in a inonogrnpli devotwl entirely to 
liiat subjrrl. riie lirld of memory is another one which srrnis to b<.' due 
for the sjunt' kind of revision. Altlion^^h we .seem to be jnstilicd in speak- 
iM;j;' of sonn* p<*opl«* as having a f:^(K)d memory and others as liaviii;: a 
pixjr mrniory, it seems that we must j^o much farther and dehne the 
kind of memory we are talkinj^ about in <»acli instance. A very detaih'd 
factor study of memory abihties using about thirty tests with a lar^'e 
*;roup of high s< hrx>l children has been carrifd out. The data have be(»ri 
recently reanalyzed, and publication will follow this later work. It 
seems now that we nmst regard memory as a complex of several abilities, 
though for practical testing purposes we mav restrict our tests to a 
rattier liniited number. 

The ability to think in visual terms uhirh we have called space 
thinking has been broken down into at least three space factors. These 
have been investigated intensely by Mr. Thomas JelFrey of the Psycho- 
metric Laboratory and the results are being submitted to the University 
of Chicago in a Ph.D. dissertation. Qnite recently, we have had some 
interest to question the relation of varions attributes of space test 
material to tlie ability of subjects to handle such material well. We are 
wondering whether the amount of njtatiiMi in the figures is a factor 
which may even be related to success at dilFerent ages, whether gfKid 
balance in the ligures may he important, and wln^tlier a number of other 
(pialitifs of the test iiilhiene(» tin; validity of tests at the various age 
Irvels. It s»ems lliat the time is already hen: when we need to go inttj 
relinemrnt or polishing of some of our present test techniques. 

FVrhaps the nuist important implication of such studies as I have been 
discussing I it's in the dire«-tMiu of recognizing the need for the construc- 
tion of individual tests of the mental ahilitiis. The group tests we now 
u.sr have hrru useful in studying of gn)Wth curves for numbers of 
ehildren. but the thorough study of mental growth seems to point in 
the dir<Tti(»n of studits of individijal growth, as it has (»ven in the cas«» 
of physieal gniwth. It is very cl«*ar tlint for very yoimg children, for 
pe(>ple with rrrlain types u{ handicaps, and for (he later age ranges we 
shall find it dillieult to make larg*j group studies as we do with childn ii 
of scIkhiI age and that individual tests of the primary abilities will be 
of nior»' use t«i us. 

When we have sueee<*d<'d ia isohiting and describing thoroughly the 
most important of the Innnati mental abilitii\s, we shall have better tooU 
for studying the complete range of human ability from infancy through 
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childhood, adolescence and maturity and through senescence. Such 
curves of growth based on studies of the fundamental human mental 
abilities will be a distinct contribution to psychological kno>Yledge con- 
cerning the nature of the abilities and the rates of their growth and 
decrement. Application of these psychological principles in the construc- 
tion of tests will provide serviceable tests in helping to deal with the 
problem of people of all ages. 



DISCUSSION 



33 

32 



ERIC 



34 1956 INVITATIONAL CONFERENCE 



Pariicipants 

Nancy Bayley, William E. Coffman, Herbert S. Conrad, John T. 
Dailey, John W. French, Irving Lorge, Elliott Metz, Thelma G. 
Thurstone, Joseph Zubin. 

MR. METZ: I would like to address tliis question to Dr. Bayley. 
You mentioned studies concerning the differential effects of praise and 
blame on learning, and consequently on growth and intelligence. I 
should like to ask whether the effect of acceptance and understanding 
without evaluatidii has been studied with regard to growth and in- 
telligence. 

It would seem to me that the adequacy of this technique in the 
clinical therapeutic situation as developed by Carl Rogers and others 
could be validly applied to the concepts of learning and intelligence. 
I would like to know what you think of this. 

DR. BAYLKY: I tliink this is a field that has not really had any 
gcxxl research done in it. It is something that I hope will be studied 
much more carefully. There are a number of studies that show that 
praise and blame have differential effects on learning. 

Now, the relationship between these and intelligence as such comes 
out suggestively in clinical studies of children's capacities, and I think 
there are some studies that show changing, increasing IQ's, or intelli- 
gence scores in children as they attain emotionally better stales. 

There are also evidences of intellectual retardation that seem to go 
with continued unhappy emotional states. However, in general, these 
correlations arc not very high. There are so many other factors that 
make a (iilTerence. I have some good examples from my own Berkeley 
Growth Study, of children who were emotionally very disturbed, but 
whose way of handling their problems was to direct their energies to 
intellectual activities. The highest IQ I ever got in this Berkeley group 
was for a child who was disturbed, but who was strongly motivated 
to handle his emotional problems by becoming a highly intellectuah 
intelligent person. I think v\e all know a great number of such people 
in ficfidernic liff^ 

Dir DAILEY: This is a very short pomt but I tliink it will help in 
thinking about a lot of this discussion. I would like to quote something 
that was done in the Air Force several years ago. They set about system- 
atically to calibrate all the aptitude tests of the Services, the USKS. 
and a mnnber of coiinnon commercial aptitude and intelligence tests. 
Just for fun, we threw in the Stanford achievement test, and a couple 
of other batteries of achievement tests. We took the reading section. 
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the arithmetic section and the corresponding aptitude tests, and so on, 
and we did something that shouldn't be done. We took the labeb off 
and looked at them as Test 1, 2. 3, 4, etc. The interesting thing is that 
without the labeb you couldn't tell the achievement sub-test from the 
analogous aptitude sub-test. If we are talking about something like 
(](^T or Otis IQ. we might just as well be talking about grammar school 
level reading and arithmetic acliievement. 

That might help explain a number of things. I am not trying to say 
that IQ is the same as reading and arithmetic, but the correlation is 
high enough to indicate such, and when you break it down into the 
IQ sub-tests and you do a factor analysis, including achievement tests, 
they come out in the same factors. In other words, a lot of what we are 
talking about in terms of group test intelligence >s very much the 
same as educational achievement. 

ClIAIRMAiV LORGK: KeUey has clearly indicated that from the 
earliest days the relationship between the so-called test of aptitude and 
the test of achievement has always been very strong. 

Are there any other connnents.^ Certainly our textb(x>ks will have to 
be rewritten on the basis of what we have heard today. 

DR. FRENCH: My question is for Dr. Thurstone. I was interested 
in the rising validities of some of your tests, and wondered whether you 
had any indication that such rises may have occurred because of rising 
rj»liabiJities of the criteria. 

DM. THL'RSTONK: I am sorry I haven't that table of correlations 
with me. I'ndoubtedly there is s(jme improvement in the reliability of 
measnrin;: reading: as you pro^^ress from second grade to sixth grade. 
I think it wasn't anything like enough to account for shifts of as much 
as twenty points. That will be in the published paper, but I have for- 
gotten the figures. 

DR. CONRAD: Is it possible that the sch(x>ls have an equalizing 
cultural elFect upon the pupils so that initial home differences are 
reduced? That is to say, the child at home in some cases will get more 
reading experience; but later on tliis home influence may be reduced 
in eomparis<^>n with the cumulative school influence so that the home 
difference which affects the achievement in the early years has a smaller 
efft^.t later on, and the uniform s<*hool expedience has a larger influence. 

DR. THURSTONE: I am inelinetl to say that just the opposite 
buppcns. The differences among the childn;n are spread out. There is 
more variability with age as they go through school. We find that in 
every study. 
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There are some other bits of evidence that I always hate to mention 
because they are so difficult of interpretation, and that is the com- 
parisons between white and Negro school children, which have been 
rather popular in the last few months. Some of those seem to show 
greater difference between the«e groups as they progress through school. 
Ill other words, if you want to emphasize the effect at home, you can 
say— and I think we need to do it— that although the school tries to do 
a great deal for these children, we cannot keep up with the differences 
in the home environment. It continues to be important all the way 
through school, and both influences tend to increase the differences and 
also increase the variability of the groups. 

DR. COFFMAN: I would like to address this question to Dr, 
Thurstone. You mentioned that your testing had been carried out over 
a wide range of ages, and later you mentioned that you used as a base 
for determining rate of growth, the mature adult level. How did you 
i'ietermine that the measures for the mature adult level were a maximum? 

DR. THURSTONE: Eighty per cent of the asymptote on our growth 
c:ijrvc', which is not projected beyond the freshman and sophomore age 
h\ college. 

Drt. COFF.MAN: What I meant was, is it possible that the base you 
t(X)k was not the proper one, that actually some of those scores would 
hiwc continued to rise s<) that the difference you found at the eighty 
per cent level might have been different if you had tested older people 
in order to get the maxininiii. 

DR. THURSTONE: 1 think so. We chose eighty per cent because 
wc were projw^ting those curves beyond our experimental data, and that 
pretty risky when you get up into the thin part of the curve. That 
is why we chuso the eighty per cent rather than the one hundred per cent. 

DR. ZURIN: I think perhaps Dr. Rayley can answer this. I am re- 
ferring to a study by Ren Pasamanick in which he held the weight at 
birth of Nej;n) babies and white babies constant, and discovered that 
the differencts in intelligence disappeared. He pointed out that there 
are three possible scientific models for explaining intolligence: heredity, 
environment, and the interaction between the two. Pasiimanick adopts 
the assumption that genetically all men are born equal, which is a 
perfe<jtly gmxi iiKxlel to start with. Most of the data which he was able 
to collect on newborn children, he says, seems to fit that model, and 
that life as represented by environment eats away the initial equality 
and produces the individual differences which we observe, by a process 
of attrition. 
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I was wondering whether you have any evidence regarding this point 
from your own .studies. 

DR. BAYLEY: In early infancy, weight at birth is one indicator of 
degree of maturity. This is certainly one measure that is used to deter- 
mine whether an infant is premature, and If you work with infants 
around a nuMith of age, you feel there is a great deal of difference in 
the HUv^^; of maturity of the child, and at that stage physical maturity 
does make a difference as to the kind of scores infants earn on the tests. 
I know PaSfHnanick has found for one and two year olds that if he 
divides the group in half on the basis of weight, the heavier children 
have higher scores and the Ughter ones tend to have somewhat lower 
srores. 

I think the differences are relatively small, and I think there are a 
great many factors, that is, there may be other than racial differences. 
We don't know whether characteristically in the early ages, weight for 
weig!it two different races are the same in general maturity. It might 
even vary with the particular racial origins of the Negroes. (African 
tribes vary in size from pygmies to giants.) I don't think we have it 
loo chfarly worked out. 

CHAIRMAN LORGE: May I again thank Dr. Bayley and Dr. 
Thurstone, as well as the discnssiuils from the fl(H)r. for this anspicioiis 
initial part of onr program. 
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Concepts of Personality- 
Then and Now 



GARDNER MURPHY 



I 

The modem era in thinking about personality may well be defined 
as beginning with the general acceptance of the evolutionary principle 
during the third quarter of the nineteenth century, and its first fruits 
in the concepts and the methods of Francis Gallon. The conception that 
trails are ingrained attributes of individual personalities reflecting the 
basic stuff of which the person is made, clearly formulated in Gallon's 
era, still has theoretical value and practical utility. The conception 
that traits of temperament and personality can be measured on objectively 
defined scales was just as directly related to the evolutionary way of 
thinking as was the development of psychometric scales as measures of 
inlellectual individuality. If you ask therefore what period I wish to 
define, when I use the word then, as assigned to me in this title, in 
making the contrast between then and now, I will say the era of Francis 
Gallon. 

The first concept defined in that era which is of special importance 
to us here is the concept of behavior traits as given directly in observa- 
tion; trails involving clusters of behaviors which can be bracketed 
together under single names like courage, complacency, passivity, 
timidity. Trails from this point of view are conceived to be attributes 
so clearly identifiable and so easily capable of reliable and valid measure- 
ment that we may regard them as building stones of a personality 
architecture. Usually associated with such assumptions are assump- 
tions regarding the role of heredity. Most such traits are held to be 
hereditary and therefore stable p^tr ♦t.es of individuality. Some, how- 
ever, are held to be environmental^ acquired, and therefore subject to 
such temporal variation as processes of learning and unlesiming may 
entail. An attempt has usually been made to treat both the hereditary 
and the acquired traits in terms of orthogonality; or, when trails 
obviously overlap, the attempt has been made to set up new traits in 
their places which will be conceptually and practicaJly orthogonal. My 
attempt in the time allotted will now be to show that these central, 
simple ideas, while continuing to thrive and be useful, have had to 
compete more and more with newer ways of thinking. It will be my 
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task to define in these few nioineiits a few of the major new conceptual 
systems of the last fifty years. 

ir 

I will begin with ideas from contemporary biology. Genetics has now 
rendered very clear the fact that what is genetically simple is at the 
behavioral level often very complex; indeed, observed phenotypic traits 
are usually reducible to networks of relationships in which many genes 
pool their forces or hiteract; and during the same time in which genes 
are busy in forming a given phenotypic trait the same genes are busy in 
forming another trait. What is therefore conceptually simplest at the 
genetic level is quite dilTerent from that which is simplest at the pheno- 
typic level. This will mean that if one does not know the genetics of a 
trait (and we seldom do know the geiictics of a trait), we shall inevitably 
define attributes which in one population behave in a very difTerent 
fashion from that in which they behave in another. There will be un- 
explained correlations and failures of correlation. Attempts at nature- 
imrture studies based on family resemblance, social class differentials 
and so on, will usually bring one headache after another. That which is 
conceptually a trait from a psychological point of view will not neces- 
sarily behave biologically like a trait, except under certain specific 
circumstances. 

W. R. Thompson (3) has recently shown that in the use of factorial 
methods it is sometimes possible to disentangle what is genetically 
complex, and to show that when factor-analysis is applied four (juite 
dilTeTcnt types of genetic pictures may underlie what appear to be the 
sanitj essential factorial structures. Of course if all that one is trying 
to do is to spot a trait at a given time and not even to be concerned 
with its development in the course of the individual, or the relation of 
the trait in one person to the same trait in his brother, no great harm 
is done. I think, however, that psychology can expect to do better than 
this; and that it can move forward in the light of modern genetics to a 
more sophisticated understanding of biological traits. 

Closely related to this point is the fact that genetics has likewise 
shown in recent years that the temperamental and impulsive traits 
are subject to the same complex biological predetermination as the 
cognitive traits; but all of them, so far as we know, are neither simply 
given by heredity nor simply imposed by the enviroimient. They 
represent very complex developmental entities which recjuire both 
biological and environmental analyses, and of course highly sophisticated 
statistical analysis of the components. It is, to be sure, likely that in 
sijme cases a trait may represent to a very large degree a characteristic 



TESTING PROBLEMS 



43 



detenniiied by a single gene. But in other instances it may be better 
conceived as a coriditioned response transferred or generalized from a 
response acquired in some other setting. In still another context a trait 
may arise as a result of the impact of massive social forces acting upon 
almost all members of a social group in such a fashion that specific 
conditioning experiences are harder to identify than the full impact 
of the SfKial pattern which is being imposed upon the members of a 
groijp. Consider, for example, the sudden impact of industrialization 
upon a village in Tennessee or in India. This all means, then, different 
conceptual schemata will have to be utilized if a given trait is to be 
defined and effecliv«-!y used. 

This is, I think, likewise the context in which we must use the enor- 
mously suggestive and valuable contributions of cultural anthropology 
and of the cultural sciences generally in the last thirty or forty years. 
It is proving to be of very doubtful value to us to resort to generaliza- 
tions that such and such attributes of personality are culturally ac- 
quired; for such statements leave out of account the nature of the raw 
material, the biology of the individual which undergoes the cultural 
injpress; it leaves out of account the sub-cultural, family, and personal 
factors which are likewise involved in such impress; and it leaves out 
of account the attempt to specify the mode of interaction between 
bi()k)gi(:al and social factors in tlit? person. Nevertheless, we must add 
cultural anthropology as one of the central factors which have sensitized 
us to the necessity of the bio-social approach. 

So far, we have been willing enough to think of many traits as identi- 
fiable components in personality structure as a whole. Some tempera- 
mental traits, like threshold for rage, may actually be pretty stable in 
the adult, and it is conceivable that there may even be a few personality 
traits which are Mendelian. The term personality structure, however, 
has proved, in the light of cultural and clinical findings, to be a very 
rich and challenging notion. There are many different ways in which 
the simplest traits of the individual may be put together; some operate 
sununatively, others subtractively. Sometimes when one trait is present 
it acts almost like an enzyme, allowing the more effective utilization 
of another trait. Sometimes several traits seem to form into an emergent 
structure, just as we rnay pass from the level of elements to the level 
of compounds, and from the level of compounds to the level of cellular 
structure. There are, in other words, various modes of organization of 
traits empirically discovered. Receiitly, biologists hke von Bertalanffy 
(4) and other originators of "general system theory,'' have shown us 
that wherever living systems are involved, the problem^of organization 
and eniergoiice takes over and complicates the problem of showing liow 
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Ihf iiidividijul trait refl^Tts the system of which it is a part. This is, of 
roiirs4». llir pnihK in wliich Gestalt psychology had likewise rais«*d serine 
de< a(h*s ajjo, notably in the Gestaltist doctrine of luenibersliip character. 
It (l(N H not sh(x:k us today to be told tliat a patcli of red in a landscnpt' 
will lo<ik dilferently if the context is altered. But it still does seem lu 
Ixillirr ns. conceptually and metlnxlologically, to b<? told that a fmii is 
oprrulionally different when it appears in dillerent contexts. Coolness, 
fur r\aniple, or tlie maintenance of a low level of afTi^^t, is a very difTerenl 
tlnn>; in a dunp*r situation and in a social gatlu-ring. 

This is of course a tremendous nuisance, botli to tlie th^Hirist and to 
iIh- pracliral worker. It is, liowever, tlie price we pay if we wish to go 
binlo*riral and to orient our psychology to the principh^ which, as 
<:<MH»ral svsteni tliwiry shows, sweep through all the sciences and hold 
for all tvpt's of scirntiilc work as sucli, Tlie insularity of separating 
psychulngy from bi<K'heinistry, biology*, and on the other hand the cul- 
tural s< irnci's, is one for which I should not like to plead. 

We are then dealing with the development of ways of thinking alKiul 
(jrrmmality wliich have been repeatedly and rather successfully verbal- 
ized, and often put into a form convenient for those who think in teniis 
nf visual iina«:*^H. It must, however be admitted that in terms o^ con- 
ceptual rigor necessary for the formulation of methods of measurement 
an enormous amount remains to Ix* done. It is so much easier to go on 
lakini; din^ctly observable forms of response, bracketing these into 
fjuiiilits. treating tliem as if tliey were entities, and then setting up 
various t\pt*s of a\*»s to repn^sent tlieir relationships and emerging from 
lliis witli the pragmatic generalization tliat somehow it works. This can 
IndetHl Im' maile to v,ork if tlie frame of reference remains constant. It 
is. for example, entirely fK>ssihIe to set up a s(icml situation in which 
an h) v^ill remain rorisf n)!. year by year, just as it is possible to sc»t 
Hp k situation in vthirU thr l^hiefFstone primary mental abilities will 
reniiiiji nnalf'vtitl hy Alie in'"fisurcd environmental factors. Or indeed we 
might s;iy it is |H»ssilile to set up a Euclidean geometry by ttiking certain 
a\inmH and ruliiij: out others. This is important and valuable for certain 
purfH>srs. If, Ihiweven we wish to work within a frame of reference in 
whirl) mixed and varying demands are made u[K)n |X'rsf)ns in mixed and 
rh ' ii^'iii;: soc ial relationships, and witli stresses within them which bring 
into activity various latent potentialities which had earlier b«*en un- 
ol)s*»rv<'<l and unrneasuri'd, and if we wish to get a conceptual system 
rieii enough to t>e ready to move in new dinrtioiis as new environmental 
factors come into our preview, we sliall b*» forctnl to go on complicating 
our scheme. If tniits and the systems within which they appear actually 
Vi\\ry grctitl) v,'i\h growth md with environmental ronditions. what will 
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the n?sult of Irfuliiij,' Uhmij statistically? What will happen if we 
complain of th«i low reliability of a ti^t wlitMi in fact the nexibility. tlie 
vrrsiitility is duo to the orf^anisnrs varyiiif^ behavior in different 
situations? 

To the plea that our s< heme has become already too complex, the 
only fM>H8ible reply is that M is still nmch 1(h) simple to do justice to tin- 
kinds of complex ehailrn^res to >\lii<'h children and adolescents j^rowin^' 
np in onr < ullure n avi. wnrrvin;; jumI <leli^Hilin;,' at the same time the 
tea< l»ers. tin- jounsclors and ihc parents who wish thai lliey <()ul<l 
inHf*islaii<l and help (hem: and still loo simple for the iniucational 
system of a nation wliidi ne^nK not only to supply an ahstraj tly valuable 
way of sorting' ami codinji; the latent < lianH-teristics of iIn population, 
but imnmIs a way of bein*c specili< :dly helpful to indivi<Iual < iti/rns whose 
complex attributes and demands are n«)t a<h^piately mirrored in avail- 
ahle trstin^' and classifying' s>stenis. 

\lon^' with the < hallen^e already <piote<l from (Jestall p'-yc holo«,'y to 
llif r!l'<^ I that eac h allribule shows nuMiibersht!,) ' Jk r,»reler in the w hole, 
^'oi N the still ^Teater < hallen^e. already liii»t<'d ip f)thr(; w<irds, that each 
person in t in h situation is in vital ropivts a nt w reactin;^ entity. 
(!iTtaiu [Mitrntials within the person are <lrawn out by the situation 
which had never been ohservnl Ix'fore, and <'ertaiii potentials of the 
siliiJilioii. if >nn will allow nu* the plirast*. are jrrasped and drawn out 
in Ihi' individa:il whi<'h h;id never been ^'rasped b<*fore. This is the 
problem to wlii< h Sears refi'rre<l in the <liscussion <jf dyadi<' relationships, 
in\<\ a corner of the problem to which Kurt Lewin referred in his deiiui- 
v'utu of the life space. 

'Mm- coiK cpt <»f <lis4'ontinuons life spaces, e;icli of which has its own 
|o;ric which must Ir' empirically defined for ca' li situation in terms which 
relhi't the im-anin;; <if the testin;: situation to the indivithial testee, is 
one whi< t» Iw^ onies iiiten^'K practical if you are lryiii«? to describe (as. 
for example. Stern. Stein an<l \\\iH»i\ {2) <lid in their recent volume), 
the relation of pn>j<i'tive fln<lin;:s to particular situational deiuaiMis 
in partic ular persf>ns. We know for evample that a Hors<'ha<'h is of verv 
linul«Hl valut» in pre(!ictin^' >heei success in naval aviation. We wonder 
why ati>one ever thonu'hl it was worth trying'. We know, however, that 
when I ,e n l.itiofi of the ptTson to the detailed structure of the situation 
to bf met is fully de^ riU'cl. the tiehl ^iluation cini and dues permit some 
pp'iliction. \nd here with a ven;rejince the th<Hirelical advances in 
oriranisinie and field studies in biohi^'y an<i those few wlii< h have been 
atteiiipt»'<l in psyeholo;;y are paying: oil' on a larj;e scale. 

I think the sjuiu' ap|M'al tn < oniph'xity ratlnT than simplicity is forc*»d 
U|M»n us as we now come into the dimensions of perMinality whioh have 
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\hvu inv»»stipal<Kl most fully by clinical rather than by experimental nr 
by sf)ri()lo;;i( al methods. I have in mind, of course, particularly the 
problem of depth dynamics, unronscions motivation, and the surfar*- 
manifestatifins at dei p level intrapsychic conllict. It has gradually be- 
nmii* clfjir to non-eliniral psyeholof^Msts that the psyrhoanalyf ic system 
(lid not deliberat<*ly court complexity for the sake of complexity but 
that human beiii^'s an* aclnally that complicated. The psychoanalytic 
N>strm hiis beronie. in a few (h»cad<»s. as complex, one mi<?lit siiy, as 
('alhnlir theulo^ry. Marxism, or literary critieism. We are dealing with 
bin-siN'ial ppKhirts \\ln»re to be sun' we often over-complicate, but like- 
wise, in (Kir i;:finranc(». oft«'n over-siniplify. Ncjw many of the traits 
whirh ♦•nn r^'f an* traits wliirh d^'seribe conllict or the interdependence 
f»f UHifiMvs. or the thn-e-way relationships between Id. Ivgo and Super- 
lii:o. Tlierr have been in the last few years— and Dr. Krugman will 
n!Hloubtedl> tril yon more of this - attempts to re-think the methods 
i>i' pf'rsi>nalif y (lia;:nnsis ilstlf to get tliern into alignment with thr 
rli'art'st and least eontro\ ersial a.spn-t of psycli<Klynaniic theory. 

Insofar as this purpose can be achiev<»d. it opcrns th(? way to con- 
reptnal riarifv an<i the development of clearly defined t<vst metluKls of 
many s/>rls. and tillers the possibility that the test nn?thods so devised 
ran be us«»<! in actual «*xp«'rin\entati(>n on psyeho<ly!mmies. This eoidd. 
if suceessful. ni)t (Jiily yield nnicli practical knowledge as to where 
p^xi hijanalytic jlh*<^ry is correet and when; it is in (Tn)r. but could 
likewise serve by meeting the ordinary canons of siinf)licity. consistency 
and prediction, with devices for testing our tests. If. in other words, 
oar t«-st s\ stems incorporate ruthlessly the logic of obs<»rvations derived 
fnan elinieal pnrctif c. they will fall down whenever (he clinical (jbserva- 
tiofis an' in error, and will stand u{) and grow stronger with the years 
whenever reality rather than error is contained in the clinical oliserva- 
lioi Hand in hand with this gfM's. of course, the fa<'t that day by (la\ 
eliniral [»ractice yields eotistantly i)"w ideas and systems of ideas which 
in thenisel\'<N will ultimately suggt^st new tests. 

ihu* serious dillieulty. of t'ourse. in nnich clinical thinking is the 
tendency to think uonnatively and seientilically at the same time, 
making value judgments a^xKit health and illn<*ss at the s;une tinn* thai 
fiUf stri\ »'s to see what is. A rhild's shyness or aggressiveness. troubl«'- 
soUM* at the time, may Jx» a f)has(» in gn)Wth. which we see less elearly 
rather than more riearly. when we (*all it "problem behavior:'" similarly 
with adults. A man's capacity to compl<*te a task may depend in part 
on trails whirh elinieally g«'t very bad names. 

\m 1 asking for tin* una li? \m 1 setting sights whirh are t4M» hi;:(i.' 
I am 4'ertainly not di inanding everything at onc<*. I do believe, however. 
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that along with certain limited uses for simple abstractions regarding 
traits, justified because they seem to work, at least in short term situa- 
tions, there is a need for developing a system of trait conceptualizations 
which are in harmony with the best knowledge we have derived from 
grneral system theory, from Gestalt psychology and from clinical 
prat lice. Such conceptualization will have to take account of the in- 
luTent flexibility of personality. It will have to find out what is fixed, 
what i.s changeable, and find ways of identifying and measuring the 
long-term trends which often underlie the changes. Relatively little. 
I think, is going to be accomplished by just deriving more names and 
studying mathematically the relations between the trails to which these 
names are given— what we might call very briefly the adjective-checklist 
way of doing personality research. More and more, I believe, will be 
accomplished by studying biological realities, bio-social realities, the 
c()inple.x structural wholes which the biological entities produce under 
the impact of various bio-social forces. 

I would throw in for good measure a concept wliit'li H. F. Skinner (1) 
has well representtnl. namely that it is often better to pursue one's 
analysis until one ran really predict the behavior of a single individual. 
Then one may dare to say that the determining circumstances have 
bi'vn recognized and controlled. It is the conceptualizations about per- 
sonality based upon simple building stones and simple combination of 
ihi^t ill summative and subtractive form, that have ^'iven us the spec!ious 
and 1 fear, short-livKi. control over practical situations which schools 
and industry, and even the Amiwl Forc*^ have been glad to pay for. 
The uneasiness of tla- last few years which these same patrons of psycho- 
lo^'ical rcsi^arch have begun to show are signs which it will be worth 
while to ht^ed. If the Michigan study faih^l to select good clinical psy- 
chologists and if the enormous labors of the Armed Forces have only 
slightly rt»dured the errors involved in picking recruits who are likely 
to find tlieniselv(»s in griive emotional difliculty. perhaps it is because 
what we know in our hearts to be neressiiry conceptual complications 
have not been rourag<»ously followcxl through in the building of tt*sts. 
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Changing Methods of 
Appraising Personality 



MORRIS K RUG MAN 



In his volume on personality, Gardner Murphy places considerable 
emphasis on autism as an aspect of personality. In this brief discussion 
of (^hanging meth(xls of appraising personality, the treatment will be 
purely autistic. I shall attempt to trace crudely the development of 
methods of appraisal as seen through the eyes of one psychologist over 
the past thirty years. 

In 1926 psychologists were generally more certain of their diagnoses, 
iind had more confidence in their measuring instruments than they have 
t(Klay. In retrospet^t, they had quite a few instruments at their disposal, 
and took them seriously. The Stanford-Binet, though less than ten years 
old, was almost universtilly the backbone of the psychological examina- 
tion, although there were some centers where the Goddard or Herring 
or Yerkes revision of the Binet was preferred. The IQ obtained by 
these tests was considered definitive and was accepted as the most 
Important indt»x not only of intelligence, but of personality. A per- 
formance Lattery lik(? the Pintncr-Paterson or the Arthur Point Scale 
was consider*^ esseiilial not only to supply a measure of non-verbal 
iiilelligence, hnt as n vehicle for observation of behavior and personality 
traits such as volition, perseverance, suggestibility, self-confidence, 
planfulnes8 and others. Clues to neurotic traits like anxiety, obscssive- 
fonipulsive tendencies and conflict were sought, particularly in the 
ptjrformance tests; likewise, bizarre behavior, autism, unrealistic ap- 
proaches, hallnrinalory material, confusion and other indicators of 
psychosis, as well as observations on irregular functioning, motor in- 
coordination, gaps in function, and other indicators of organicity. 
Psychologists were beginning to employ projective approaches by adding 
(lualitative approaches to objective measurement, although the term 
*'proj(»i!tive methfxls ^ was not coined by I^wrence Frank until 1939. 

Achievement t(»sts, diagnostic tests, aptitude tests, and a great 
variety of apiMMal tests were available to the psychologist thirty years 
ago. Personality tests were in existence, although still used sparingly. 
In vogue at the time were the Prcssey X-O and the Downey Will Tem- 
perament Tests. The Pressey was one of tJie forerunners of the per- 
sonality questionnaire in which *Mike" and "dislike" were used, while 
the Downey was a projective test without the name, using normal 
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handwriting and handwriting under stress to judge probable beliavior 
under stress. A much older technique employing a stress situation was 
the mirror-drawing test, which was widely used at tlie tinie. Personality 
inventories were also in common use. These generally were of the bi- 
polar type, purporting to measure such traits as introversion-extra- 
version or ascendance-submission. Pictures, cloud pictures and ink- 
blots were available for the study of specific traits rather than for total 
personality appraisal. The Porteus Test was used to measure plaiiful- 
ness, the Knox Cube, immaturity, the Kohs Block Test for organicity 
and frustration tolerance, and a great many otiiers for specific purposes. 
The Rorschacli was in use in Switzerland and Austria by psycliiatrists, 
and was known in this country only to a few until the publication of 
the blind analysis by Oberhol/er, and tlie articles and dissertation by 
Beck. Rating scales had a tremendous vogue for personality appraisal. 
Attitude scales were also widely used. All in all, the psychologist of 
thirty years ago had quite a battery of psychological instruments to use. 

The psycliologist of 1926 was generally employed in a mental hospital, 
in an institution for mental defectives, in a psychological clinic con- 
ni'cted with a university, or in a child guidance clinic. A few served in 
school systems, mainly in connection with the education of the mentally 
retarded. When a psychologist functioned in a rcscareh department of 
one of the institutions listed, he often was in a position to do inde- 
pendent creative work, and many of the developments in clinical psy- 
chology came from this source. However, when he was engaged as a 
clinical psychologist, he was usually e.xpectiHl to do mental testing only, 
except in the newly developing child guidance clinics. Only when psy- 
chologists were well established were they pennitted to delve into the 
mysteries of personality. Psychiatrists were, as a rule, less dynamic 
thirty years ago than they are today, and psychotherapy, even for 
psychiatrists, was limited to the private practice of psychoanalysts or 
to experimental ion in some of the more advanced child guidance clinics. 
Most psychiatrisLs limited their function to diagnasis, not only of 
personality deviations, but of intellect. Psychiatric textbooks of the 
time usually contained a chapter on the measurement of intelligence, 
which consisted of a translation from the French of the 1905 or 1908 
Binet-Simon. Twenty-five or thirty years ago, psychologists fought for 
the privilege of doing mental testing. Today it is almost impossible to 
employ a psycliologist who is willing to perform diagnostic services; 
everyone, including the most recent graduate, seems interested only in 
therapy. This is not stated in criticism, or in judgment, but merely as 
a fact to indicate the tremendous change that has occurred in the status 
of the psychologist. 
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As fKsycliKitrists shifted from more classiHcatioii of mental disease to 
llu' more dynamic Freudian psychology, they abandoned the field of 
mental tesliri*; to tlie psychologist, and, as psychologists improved their 
training and developed new approaches that commanded respect, psy- 
chiatrists and psychologists shared responsibility for personality ap- 
praisal. The concept of the clinic team and orthopsychiatry was develop- 
ing, liven the liorsciiach. which wa.s originally a psychiatric tool, was 
being li»ken over almost entirely by psychologists. In the meantime, 
p.sycliologiNts were experimenting with immmerable teclniicjues and 
devices in the hope of discovering an nll-pnrpose instrnment for ap- 
praising personality. The psychological lileralnre of the past twenty-five 
\e;n's is replete with preposterous claims, and many instruments had 
brief v(»gue. only to be replaced by (»thers that ultimately proved no 
better. In the main, efl'orts at devising uicIIkkIs of persotudity appraisal 
Were in luodilVerent direclions. each with several subdivisions: one was 
the exprritrM rthil-statistieal approach, with emphasis on standardization 
and \:ili(jation by one of several metlxKis, while the otIuT was the 
intuitive approach, with heavy reliance on clinical intuition, using 
nnstrnetured or partially structure(i situations as stinmli for reaction. 
I nder I he lirst. we saw I hi development of Innidreds of dilFerent per- 
sonality inventories, trait in\entories. preference (|nestiomiaires. attitude 
seah-s. and self-rating scales. Mxcept for the very early ones, the t(»ndtrncy 
was to standardize psychiatric concepts in simpliiied statements, with 
simple administration and scoring, and. usually, with group administra- 
tion possible. The tin jry back of these qtJestiotmaires was acceptable, 
except btr the assnmpti«>n that the (|ncstions were truthfully answered. 
These inslrnrnents were to be so objective that scoring and interpreta- 
titin could be automatic. The major dilliculty willi them was that, in 
spitr ofgiHxl statistical and surface validity, most of thetn showed little 
clinical or life validity. Nevertheless, these i[istrum<'nts had considerabh' 
usefulness for the sensitive cliriiciati who employed them (fualitativdy 
rather than (piantitatively. in conjunction with other techni(|ues, par- 
ticularly with the interview, the case study, and ol)Servation. On the 
other hattd. these instrumetUs did a great deal of harm bccau.se of their 
widespread Use by unqualiiied persons iti group situations who often 
made serious imwarranted ciiag[U).s(\s on the basis of nmnerical .scores. 

In the second category, that of the partially structured instrument, 
later to be called "projective.'* many clinical psychologists felt that at 
last they had unh^^ked the door to the mystery (»f personalit y appraisal. 
Inkblots, cloud pictures, picture interpretation, iticomplete drawings, 
lignre and other drawings, painting and lingrrpainting. sentence coin- 
pietion, story completion, picture completion, mos<'ucs, situatiomd tests. 
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haiidwrilin;,'. <'Xprrssiv<» niovfiiieiils. and a j,'ruat niaiiy others developed 
with iM^wilderiii;; rapidity in the decade from 1930 to 1940. Seldom did 
test eonstruetors hollnT with validity, except iu indicate that '•clinical 
experience" [)rov*»<l the validity of the inslrnnM'nt nnder discussion, and 
that fnrth*r evid(Mic»» would be providt^J in the va;;uc future. The 
irirvilnblc happrin d and reaction s<*t in wIhmi workers hi *;an to test the 
validity of tin s«.' iuslrunienls. and found most of thrni weak, fii many 
eas<»s. the reaction was nuicli more violent titan wiis warranted, sitire 
the (xiteria for jtjd;(in;,' the projective iiislrnnient were thosi? of the 
fjcrsoiialily inventory intended for use by relatively untrained workers 
rather than those of complex clinical iuslrunienis to be used only by 
hij^hly trained < lirjical psycholo^'ists. After twenty or more years of 
violent debate, psyc holo;;isls are still sharply divided into two camps 
on the (piestion of fiersonality appraisal: the objeclivists. who clamor 
for stalistiral validity, and wiio consider oth.r ( linieal approaches 
uns4'ientilie and noH iM'aded. and the subjectivists. who consider statis- 
tical approaches undynami(\ and empiiasi/e the complexity of human 
liehavior and the need f(jr intensive trainin;^^ and clinical insi^^lit for 
p4*rsonality appraisnl. I have no <-otivincin»: evidence for this, hut my 
impression is that the majority of elitiital psyeholo»rists are in the 
lattiT cat«'p>r> . 

I have betn doiii',' little more than reminiscin»r. and at this point it 
<M-curre(l to nn* to cheek my reactions a;:ainst the opinions t»f accepted 
authorities in the lield. In linn^s' I'ourlh Mental Measurerueiits Year- 
b«M)k (I^.Vi). reviewers reviewed 1*K\ tests. ;;ro«iped in 13 cate;;orics. 
The cate;:ori« s with the lar^?est inimber of tests reviewed are those of 
"eharacter and persnnidity" and "v(m alions." eaeli >vith 121 tests. 
S«\enty-t\\o lairly well known ps\cholo;:is(s reviewe'd the 75 rmn- 
projeetive t«'>ts and Ui projective instrurnetits in the secliciU on tests 
of eharacter and personality, and in scanning' this larpe section of the 
viilnrne. the impression is c;athered that the majority of reviewers found 
both the projective and the not»-f»roject ive tests seriously lacking in 
validity. !b r«' are samples of many sitnilar sentiments from reviews of 
dilferent teNts h> dilFen'nt review **rs in the Mental .Measureim^nls 
Yearbo<)k. Most of thern are IVntn the surnnniry statements of the 
reviews. The lirsl ^Toup of (piotations is fniui the section on non- 
proj<H:tivc tests: 

"There is no indicati«)n in the litrrature that it can be depended 
U{>on to piek out of a ;,Toup all maladjusted individuals . . . 
Its jrreatest usefulness would app*'ar to be as a guide to inti r- 
view and as an aid to better understandin<^ of tlie individual.** 
. . (hx's not ^^ive the irnpressicjn of being an instnimenl that 
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ran measure objectivity in children, nor are the author's claims 
that it does so substantiated by the evidence presented . . 

. . the inventory does not fulfill the reviewer's specifications 
Tor a useful diagnostic aid in counseling, although this is the 
expressed purpose of the inventory.*' 

'This technique continues to be best characterized as an ex- 
perimental device rather than a test method.** 

"In my experience, questionnaires are not readily suitable in- 
struments for use in industry.'* 

**Any use of (personality) questionnaires in research altogether 
is of doubtful value; I do not feel that this particular question- 
naire is an exception to the rule/* 

"As to differentiating persons with serious personality difiBcultles 
from the normal population, it appears to be, like other inven- 
tories of its kind, not very vnlld for the individual case.** 

"Where the individual is comerned, it should be used as an 
adjunct to the interview, not as a substitute for it.** 

"The illustrations given of the use of the inventory in educa- 
tional practice do not convince this reviewer that this test 
has a useful function in general education.** 

"In sum: Inventory, while as good as most of the 

similar tests of this type, seems to have only a screening use- 
ftihu'ss; and it is depressing to see our counselors being en- 
ronraj^txl to use any instrument of this sort in dealing witli 
individual coimselees who have gone beyond a screening process. 
Ml contemporary personality inventories, including this one, 
have doubtful individual diagnostic value.** 

"It is difiicult to know the extent to which this type of question- 
naire can be used because there is no evidence presented that 
the alleged areas measurcti have any meaningful existence, or, 
if they do, that they can be measured by questionnaires of this 
type. Tlie path of rescan h in personality measurement is much 
more thorny and difficult tiian is suggested by the authors of 
inventories and questionnaires; and, until they face more real- 
istically the problems of taxonomy and validity, their products 
will be of doubtful scientific value.** 

"The test would appear to be of greatest value when utilized by 
an experienced clinician with emphasis upon the qualitative 

aspects of the test results.** 
"The general advantage of the inventory seems to be based on 

the future promise of the general factorial approacli. Regardless 
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of the geiienil promise of this approach, data are not yet 
avaihiblc showing the pra(^tical utility of this inventory/' 

*This test must be considered to be of research interest only." 

"The inventory will probably be used by guidance officers in 
. . . schools where psychologically trained persoiuiel are not 
available and where there is a basic phihisopliy of adjustment 
by conformity." 

*'There is no evidence that the test can be used for the prediction 
of imman behavior." 

**Asi(le from the fact that ... is no worse than most conven- 
tional personality inventories, there is little that can be said 
in its favor." 

"At this writing, the validity data are too sparse to warrant 
drawinsf general eoru lnsions with ref^ard to the applicability 
and nsefnliK'ss of tin* t«*sl/' 
"This is just another (mm* of those toss-a-eircle-aronnd-tlie- 
synibol-f(>r-your-problrm invontories which holds no promise 
of (Contributing any inonr to our understanding of pupils' prob- 
l(»nis than the scores of others which represent the lowest form 
of the tt'stinaker's art ... It is hoped that we will soon pass 
that naive slage in educational and psychologieal thought in 
which we expect to get at important problems by a hurried 
mass approarh. Perhaps these inventories will find their best 
use in hoiilires celebrating our emergence from the ruts that 
the personality and adjustment testers, ably abetted by high 
pressure sitlesmeii, have carved out for us. Careal emplor," 
These quotations from test reviews are typical, and while then* are 
other neutral and even positive reviews, the majority opinion ()f re- 
viewers seems to be exemplilied by these statements. 

The projective teclmicjues fare no better. To present only a few 
(luotalions, by way of example: 

**At the present time the test is sadly in i»eed of supporting 
vali(hilional studies, and until these appear its diagnostic 
employment should be more experimental than routine." 
"The author wisely suggests that it be used oidy by clinical 
psychologists with general competence in other projective 
tests and with a broad kiiowhnlge of psychoanalytic theory." 

. . the extent to which a protocol is actually representative 
of the subject's psychoscxual (h'velopinei»t, has not as yet been 
demonstrated. This piuhlrm. however, exists in relation to all 
prnj<»rtive tests." 
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**At its present stage of development the (test) is a very promis- 
ing tool for the experimental study of children's attitudes and 
personality development and for the clinician who is ready 
to use the results of this test ... to build up a clinically shrewd 
and (hopefully) consistent concept of a personality; it is not 
ready for those who wish quantitative or even qualitative 
guideposts to normative status or to differential diagnosis." 

**It may be well to point out, however, that, since it a pro- 
jective technique, its value in this field is directly proportional 
to the ability of the individual attempting its interpretation." 

**In line with a tradition stronger in European psychology than 
in the United States, he seems to imply that emphasis on 
interpreter skill is incompatible with emphasis on objective 
norms. Understanding, intuition, and internal consistency are 
sought, rather than objective evidences of validity. Thus, 
though a skilled examiner may find the test very useful, we 
have no scientific indications of where its limitations and 
greatest usefuhiess lie." 

. . it seems worthy of wide experimental trial in the hands 
of persons with the requisite interpretational skills." 

. . original manual for the (test) is perhaps one of the worst 
horrors ever perpetrated in the field of clinical psychology." 

"There is no doubt that the test has possibilities as a projective 
technique; but as the author implies in his manual, it needs 
much more work before it can be considered a proved clinical 
instrument." 

**rta interpretive scheme requires theoretical assumptions which 
themselves need to be tested at a much more basic level. This 
reviewer does not feel that the assumptions are invalid, but that, 
since they are assumptions, they do not justify the formal 
structure of the scoring system here proposed by the author 
of the test." 

"In view of the lack of reliability and validity data, the use of 
the test as a clinical instrument at this time might be prema- 
ture." 

"On a research basis, its use should be strongly encouraged. 
As a test, it is still essentially unproven." 

^'TUis contribution to . . . projective techniques will be received 
enthusiastically by those to whom the theoretical assumptions 
of dynamic psychology are congenial, and examined with 
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suspicion, probably, by those who look for statistical or other 
(|uniititative evidence of valiUiiy for a test of personality/* 

**One may hope that the fu^iv»! of this promising technique will 
be marked, not by slavish adbereiiee to formulas, but by sound 
research to determi?vc its validity— and its limitations/' 

^'Whether the tes'^ has uro merit as a personality test cannot 
be assessed sin. . ihe only evidence of validity {.nven is the 
relatively low correlation with a test which can hardly be 
considered a criterion/' 

**(This) test is a clinical techni(jue, not a psychometric method. 
As such it has the advantages, and is subject to the limitations, 
of other complex, flexible clinical tmik In its present stage 
of development it is an aid to psychological investigation and 
interpretation, the usefulness of which depends upon the 
clinician who applies it/' 

*'At present it appears to the reviewer t!iat the clinical use of 
both forms of the (test), except in relation to other tests or 
case history material, is hazardous.'' 

^ Pending more positive statistical and clinical validating find- 
ings, it will have to contimie its precarious position in the field 
of projective techniques." 

*'Those who look for validation data will see oidy large claims 
and little (evidence." 

*'^<»nding the publication of adequate supportiiig evidence, the 
jj,v,chologist using this method is proceeding on the basis of 
faith and should he willing to recogni/e the perils of his course." 
**ln(lce(l. even the friendly observer caimot escape the impression 
that in many instances the utilization of this rather tedious 
and time-i'onsuming technicpie serves no purpose that could 
not be accomplished more efliciently by personal interview." 
"Any step of true research i{i the projective field is encouraging, 

. . . but much of the path of progress lies ahead." 
*ilere is another of the all too numerous family of prematurely 
published, invalidated projective tests/' 
It seems no exaggeration to state that, in spite of thirty years of 
extensive experimentation and in spite of a vast array of instruments, 
projective and non-projective. that are available tcKlay, we do not now 
have instruments for personality appraisal that are generally acceptable 
to psychologists. There seems to he a growing belief among many 
psychologists that we have, perhaps, been or the wrong track in seeking 
such instruments; that personality is so co'uplex, and personality factors, 
at best, so uiistable. changing rapidly from situation to situation, that 



•^2 



56 



1956 INVITATIONAL CONFERENCE 



simple approaches to personality appraisal can yield little that is vaL'd. 
Much of the experimentation in personality appraisal has been em- 
pirical, ifjnoriiig to a great extent the great development, over the past 
25 years, in theory of personality gro>vth and development, and in the 
basic concepts of psychology, psychiatry, sociology and anthropology. 
There are, however, many encouraging signs to indicate that we are 
emerging from the empirical stage, and coming closer to the utilization 
of current theory and knowledge about personality, in our approaches 
to understanding and appraising personality and behavior. I shall close 
by merely listing a few of these trends, without presuming to guess 
wliat the future holds in store for us. 

1. Psyehologists are mueli more critical than they were, and do not 
take on faith everything that is published purporting to measure 
personality. They are infinitely better trained in fields related to 
personality development than ever before, so that their judgments 
are more trustworthy. 

2. Opportunities for using this training are greater than ever since 
psychologists have demonstrated the contributions they can make 
in diagnosis and therapy. 

3. Concepts of personality and behavior are more dynamic than here- 
tofore, and are more acceptable to psychologists of all shades of 
opinion. More and more are psychologists deserting the hope for 
simple approaches to personality appraisal. Even the fantastically 
elaborate appraisal programs of the Oflice of Strategic Services 
and the \' A program for appraising clinical psychologists proved 
disappointing. Mow, then, can a single inventory or a projective 
test serve the purpose? 

4. In spite of the rash of new instruments for personality appraisal 
over the past twenty years, there is now a tendency toward con- 
solidation, critical review, and research with existing techniques, 
using dynamic theory as a basis, rather than haphazard production 
of new tests. 

5. While experimental ^jaj^^hologists are becoming more dynamic, 
clinical psychologists are becoming more research minded. 

6. In some recent publications on personality appraisal, the trend is 
liway from attempts at omnibus or global measurement of per- 
sonality, and toward a very specific look at a limited sample of 
behavior in a specific sf' nation. Gardner Murphy warns us that 
the study of the situation in which aji individual functions is as 
important as the study of iimer drives. 
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7. Concepts about the dimensions of personality are undergoing 
radical changes even among statisticians. We are beginning to 
see objections raised to the unJdimensional profile of personality 
presentation, and tendencies in favor of multi-dimensional ap- 
proaches. 

8. More and more do we find criticism of all types of instruments 
for irjdependent use for personality appraisal. When such instru- 
merjts are used, they are used to supplement rather than replace 
interview, observational, and other techniques. 

9. More and more do we find recommendation of the case study and 
observational techniques by qualified psychologists rather than 
reliance on test scores or formulae for personality appraisal. (In 
a very recent volume the "anamnestic study" was recommended 
as a new approach to personality study. Twenty-five years ago 
the '^anamnestic study," commonly used in mental hospitals, was 
discarded as undynamic, and the social history substituted.) 

10. More and more do we find multi-discipline approaches to the study 
of personality. Simple approaches are becoming suspect. 

This, then, is what it looks like to one psychologist scanning the 
thirty year period. We seem to have come the full circle, beginning 
with the psychologist using available devices as tools rather than goals, 
going through long periods of search for simple objective measures of 
personality, emerging recently with much more mature, sophisticated 
understanding of the complexity of personality and its interaction with 
complex and fluid situations, again apparently ready to use the best 
available instruments as tools rather than goals. There is, however, a 
tremendous difference between the psychologist of today and that of 
1926. The modern psychologist has a keen appreciation of his own 
Hmitations as an observer of human behavior, and the limitations of 
the instruments he uses. He does not rely unduly on personality ap- 
praisal instruments, although he uses them constantly. He knows there 
are no shortcuts, no royal roads, no panaceas — at least not at this 
moment. He uses everything he can find — objective, projective, sub- 
jective, to meet the needs of the moment, searching for better ways, 
but he is not satisfied with what he has available. 



58 



1956 rWlTATIONAX CONFERENCE 

Testing— Then and Now 



BEN D. WOOD 



The most visible difference belweeu **tJien" and "now'' is represented 
by the size of this Invitational Conference as compared with its size 
when its first annual meetings began about a quarter of a century ago. 
In those times we were not so numerous; nor were we opulent enough 
for such a sybaritic feast as we havo just enjoyed: in those days the 
more fortunate lunched in tlje Coffee Shop, while the rest of us patron- 
ized a drug store or a lunch wa^ron on a side street. I am curiously 
reminded of what Will Rogers said to an unexpectedly large crowd that 
greeted him at a southern airport during the great depression that 
marked the first years of the Cooperative Test Service, of the Educa- 
tional Records Bureau, of the Ponnsylvania Study, and of this organiza- 
tion. Looking over the vast crowd that had gathered to greet him, he 
said, '*I had no idea unemployment was so bad in this area.** The size 
of this gathering is a highly deserved tribute to the leadership of 
Educational Testing Service. 

Perhaps a brief digression oia the origin of this conference would be 
in order, especially as thrre may he a lesson in it which we should take 
to heart. When the joint conferences of the Educational Records Bureau, 
Cooperative Test Serv ice, Progressive [Education Association, American 
Council on Education, etc., began, our programs were liberally infested 
with testing leaders and test ti^chnicians; and during the discussion 
periods, there was a slight tendency for the technicians to display their 
technical erudition in arguments that were usually polite and often too 
long. The schoolmen who were the bulk of our audiences quite frankly 
admitted they did not understand the technical lingo; and only polite* 
ness led them to conceal their suspicion that the technicians didn't 
either. Some disputations that were \u*^rd in those days indicated that 
their ill-concealed suspicioiLS were not without foundation. Be that as 
it may, our technical vocabulary put them to sleep or drove them to 
the bar for transfusions of one sort or another. Thus fortified, they 
descended on the Program Committee and let it be known that such 
nonsense had to be eliminated or reduced, or else. 

Well, of course, when your paying clients show such inadequate ap- 
preciation of pearls of wisdom, you have to remove the pearls from 
their programs. But still the ProgramJCommittee was convinced that 
such pearls of wisdom were d<*sirable; indeed, were necessary for progress 
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ill tht; t«,*6tiii{^' liiovtMneiit wliost* I* rs at tliat stage were mostly workiii;^' 
ill i.s<jl;iti()ii. without any national meetings specifically designed for 
their intends ts. ThtTefore, the Program Committee kept its technical 
speakers, hut scheduled tli(»in on Saturday after the scli<xjlnien had 
relurinNl lo their scIhxjIs. 

\t lirst we were deeply coiieeriied about the problem of iiiiding an 
.'iiidit^nct* for lliese ^rift»'d speakers. V\ illi only a dozen or .s(j showing up 
for thf lirst few Salurday sessions. \\r wiTe afraid our speakers would 
ijnit. Hilt I he dtMiieation of our speakers made our anxiety seem childish — 
lln*y cjime hack year after year with long»T sp(?ecli<s and constantly 
iiUTJ-asiiig' technical vocabularies. One of our elder schoolmen who wit- 
nessed this phenomenon siiid it reminded him of the character in a 
Hernanl Shaw play who e xplained that he had to preach even though 
111* had iiont* to h(*ar him arid nothing to say. 

Hilt our speakers did have sf>nielhing to say; what they said became 
increasingly signilicant every y«-nr. The size of this audience today is 
;iniplf viii<lieati<jn of the plan adopted in the early I930's. When the 
success of ihe Saturday c<>nference was [K)inl*-fl out to one <jf our elder 
^'h(M>lm<'ri. hi' not only olfert'd congraf'/tlatfons n^^t f a pressed regrets 
at the iircfs>»ity f(jr redncing the immh'r of t«*<*finical spee,*clies in the 
joint conftTriic f programs that have a/w'^iys I "ii scJirf^ i -d ow Thursday 
an<l l'rida\. His expression of regnrls ' w ^ir - <n . h.it mviderhUandably 
fjot (juiti' as firn>ive as his expressions p^' ' on^^.'Anla liorw. 

Another dilfcrfnce between "thtiif and riww"* is 'ili;it certniin criti- 
cisms against ohjeclivt* tests lh«»n iiVrtfueul inw f. ^t oft<'in heard, 
at least nttt frorii the ^ame Muirces. In l.lu' * aii ]'>2U'^ hi was ai s<Tious 
problem ti> gi t an> IhxK to use «)I)jerli\ .slsat all. < vrii experir/nentally. 

In those \ears there was a w idesf)rt''ad n-^^clitMi against ^'/le Army 
\lpha and its \ a I hr^wHl. not (>nl\ ht'cau'^^i' <jf Ih'* linii(ali<vijs f>f those 
early tests hut e\rn more. I Ihink. because <;j' iheii exfr/.vagaiit claims 
and their misnsr. uhieli oftt ii ii^ Inderl lr>i.M;; lo iUi more accuratt'ly 
uhal ooLrh' not to |m' dojjr at :t|l it! hon»I^ 'l''<Jm'ated to f f^i* ('<jn<'Tvation 
of hnmaii resonrers and to th«'g«'neral welfare, as against blind adlirTciice 
to rigid eiirrieiila and pnitiliv«> d<M'trines of di.s<>if)liiie. I'his partly laud- 
able and lai^*' ly temporar> reaction was. however, only a minor incident 
compari'<l t(»a t \ pe of anta;:(»in'>m i)ased on alitxtst inslinc'tive opposition 
to an) filing new. and an etpially tropislie failh in and allegiance to the 
old and' f trniliar. Allergy to new idr w is an almost niiivers:d human 
disease. If I fail to inehide any f)alinodes Iktc. it is not because 1 have 
h«*eii innnnne to this eiulernic malady, but because I wish to slay within 
the time aiul space limits assignee] by the c haiiinan. 

Typical of the object iorrs to obje<*tive (ests were I host* made when a 
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proposal to use "new typ<r* placement tests in Columbia College was 
hc'ug discussed about 35 years ago. A Frencli vocabulary test was de- 
clared unacceptable mainly because the examinees would *'beat" the 
lest by the simple trick of memorizing 1,000 or 2,000 words. I was urging 
llu' t^xperimental use of the proposed placement test because I thought 
it hiid some important potential values; but I iiad to confess that in 
my wildest fligiits of coiilidence, I had never dreamed that our innocent 
little vocabulary test c«iuld ever produce sucfi a miracle. I nfortuiiately. 
tilt: fears of the critics were found to be groundless: after 30 years of 
Mslii*:; such vocabulary tests, teacliers are still lamenting the inadequate 
vo< abii!aries of their students — and their bmentalions are amply just i- 
litnl by the results of t<»sts, both old and new type. 

Tfit/se and similar objtxrtions to wliat we then calltHl '*new-type" 
tests were nearly always accompanied by entlmsiastic approval of the 
ess;iy type of exiiiiiinatitms. Some of tlie expressions of approval were 
quite unrestraiiiifi: the es.s;iy examinations * 'forced pupils to think 
rreatively, to or*:;mize tlieir tliougiits logically, to marshal! their argu- 
ments C(>liereritly. and express tlieniselves persuasively." Some of *he 
paiu'gyrics were more cautious: the essay examinations "gave oppor- 
tunity to think, to create, to organize, to be logical, to write coherently, 
pe rsuasively and artist irally" and tims "positively invited" the pupils, 
one ;itid all. t«i indulge in these unquestionably desirable, but to some 
ptipils slightly vagrje if not esoteric* blessings. These claims were made 
at a time when « um[ilaints wrrr widespnN'id, in as well as out of academic 
eireles, that the writing of many college (graduates was at best semi- 
litenite. 

Tlitse complaints w(Te accepted as amply justified after centuries of 
exclusive ns4» of ess;iy-typ*' examinations throughout the schools and 
collef^es of the world. Tlu? essiiy-type examination undoubtedly aflbrds 
opportimity and oIFits invitation; but its son h -times alleged power to 
furce (Tcative thinkin<:« *'ir(*ctive writing, etc., is too often an example 
of :ni irresistible fore*' coming' inl(j conta(*t with an inmiovable body. 
F-«*st 1 lie inisiHiderstfxKj. 1 hasten to interject that I have never know- 
ingly a(lv(Kated the eliniitiiition of the ess;»y examination, which some 
funnerly fervent protagonists have apparently abandoned. I have tried 
to maintain the values as ^^ r|| as the limitations of all kinds of tests and 
ipf ()tlnT sources of information for grridance purposes. In general, I have 
trir<l to »'mphasize the importance of distinguishing the measurement 
and instructional functions of tests, examinations, and other devices. 
Both functions are nccessiiry, and neither should or need bt? sacrificed 
to the otluT. Since examinations have traditionally been vm^l for com- 
petitive and often invidious purposes, and are still thought of too exclu- 
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sively in relation to such purposes, it would be ideal if instruments that 
produce the best measurements could also serve as the most effective 
teaching devices. Although substantial progress has been made, and con- 
tinues to be made, in producing objective types of tests that measure 
elements and combinations of elements that more nearly approximate 
some of the important goals of instruction, fortunately no one is as yet 
satisfied, so far as I know. 

But that the progress thus far made is decisively important cannot be 
questioned. While I have always felt that the bad effects of objective 
questions and the good effects of essay examinations on learniwg were 
somewhat exaggerated, there was a time when some of our wisest 
educators and leading experts in the field of measurement were so fearful 
of the evil influences of objective tests that no reconciliation seemed 
possible. It is gratifying to note that the improvement in test production 
has been great enough to permit almost exclusive use of the objective 
types of tests, espw:ially those that can be scored by machine. 

This mention of the test scoring machine, for the development of 
which wi> are indebted to the educational interest and multiple genius 
of the late lamented .Mr. Thomas J. Watson, and to the great corpora- 
tion which he created, recalls another difference between **then*' and 
'*now*' which involves some vivid and aiimsing memories for some of 
us who were associated with that development. 

From the beginning of my work in the testing field, my chief interest 
has always been in the long-term systematic and constructive use of 
tests and other sources of information about the abilities, interests and 
needs of pupils as GROWING individuals, rather than in one-shot 
efforts to separate the sheep from the goats at any one point on the 
educatioail ladder. I have always supported college entrance, scholar- 
ship, and single-shot competitive examinations as necessary and de- 
sirable; in fact, I have helped construct and administer some tests of 
that type; but I never considered them sufficient for constructive 
educational ana conservation purposes. FVom the boj^innin;? I felt that 
systematic testir and guidance should be an intcgrnl part of the whole 
school procedure, from kindergarten througli university and on into 
appropriate gainful employment in the work of the world. The in- 
scription over the door to Dr. Colton's famous museum in Flagstall", 
Arizona, says: 'This museum exhibits, not things, but ideas.'* My efforts 
from the beginning have been dire<Hed at selling, not tests, but the idea 
and practice of individualizing eduealion by continuous guidance based 
on cumulative records of all khids of relevant information about indi- 
viduals, including scores from tests that are as nearly comparable as 
Ujey can bo made. Selling this idea, which is at least as old as Plato, 
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was and still is a formidable task, rtHjuiring notliing less than a funda- 
niciital n'driuiitatidii of the masses of our teachers and school ad- 
ministrators. 

Our early experience with placement tests in Columbia College, and 
with similar tests in the Regents Experiment with New-Type Tests, 
sij^rj^rstfd that even with the economies and other advantages of ob- 
jective tests, and even if by some miracle all scli(X)ls could be persuaded. 
uiii\ eral testing and guidance of the type that obsessed me as necessary 
v\.Mild be prohibitive in cost. A bit later, our experience with the East- 
man . rhing Film Experiment, the Cla.ssrcKjrn Typewriter Experiment, 
and especially the Carnegie Foundation Pennsylvania Study, the Edu- 
f-atinnal Records Bureau and the Co{)perative Test Service, convinced 
n»e that tin* cost and errors of scoring tests and processing their results 
had to he drastically reduced in order to make their values available 
to all ( liildrcn in all schools. 

rite ridtion super\eiied lliat IBM tabulators could be adapted to 
sfati^tiral procedures. By Mr. WatMiii's generosity and faith we secured 
Mie loan of a large installation of tabulators and related efjuipment. 
Si v^ ral time- and money-saving adaptations of existing tabulators were 
made hy Warren and Mendenhall in a few months, and within a year 
th. >. in collaboration with IBM engineers, designed ^nd the company 
produced the first statistical tabulator. A year or two ago, Mr. Watson 
n frrnd to this machine as the first of IBM s mechanical "brains." 
Two or three years later, IBM engineers mechanized Bulon*^ method 
for scoring Strong Interest Blanks on the standard tabulntoi. But from 
tile beginning, our greatest efforts were devoted to developing a test 
scoring machine. The first niaeliin^*, using the ekctric-eye sensing 
method, turned out to be tor) slow as well as too expen.sive. The soluti<jn 
rmally (ame through the brilliant inventiveness of Mr. Reynold B. 
.Joliiison. an IB.M engineer who is now head of the IBM liesearcli 
Laboratory in San Jose. California. 

One of the moH' amiisini; incidents following the announcement of 
the t»sl scoring machine was the rumor, which I was never able to 
vrrify. that some highly placed professional (educators had said we wouhl 
m»"chani/e and ruin education with that machine. 

I fie addition of the item analysis unit to the scoring machine, which 
I aju told was the first analogue computer ever built anywhere for any 
f)nrpose. and which was intended to reduce the drudgery, cost and 
errors of .s<-oririg objective tests, widened its scope to test construction; 
a!i(l the addition of the I hurstone-Tucker Matrix Multiplier unit made 
it into a research instnimerit of substantial importance. 
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This machine came a\oi\^ just in time to make substantial conlribu- 
lions to tlio testing work in our armed forces during World War If. 

In addition to the alleged fears regarding the danger of mechanizing 
education, there were some other unfavorable criticisms, but in recent 
years the only criticisms I have heard are that the machine is not fast 
enough nor versiitile enough to meet the needs of the increasingly large 
objective testing programs in our country. I am confident that tin* 
existing and still greater needs of the future will be amply eared for by 
two typrs of rnadiines. The first is Dr. Lindcjuist's giant scoring and 
pnx'j'ssing rniu hine. which represents an nchievenient as great as Dr. 
Liruhiuist's notable contributions to the art of writing test ilerns that 
lap abilities riiore complex than memory and single-step reasoning. The 
second is the forthcoming new model of the IBM test scoring machine, 
which can be used in combination with one or more of the new IBM 
electronic data pr(x:essing machines. 

It would probably not be (expedient to speculate too deeply on the 
real nsisons for the currently more favorable, or apparently mor ' 
favorable, attitude towards objective tests and their mechanical or 
rieclronic finK-essing. As yon may recall, the General Motors diesel- 
t»lrrtric l(K'ornotive was not n'ceived with unanimous approval. Sonn* 
of the major railroads (jutstioned the ade(iuacy of its dra\>bar pull, 
nnlil they (>bs(TV(»d tha» it was great enough to pull 37 railroads out of 
iKiMkmptey in three yt^ars: then under irresistible financial motivation 
thry swarnpei' ( M-neral Motors with orders. I can only e:(press the hope, 
rinndly. tlint pecuniary motives are not tin? uiilj reason for the ap- 
piuvntly riion* favorable attitude toward obj'\*tive tests and scoring 
inarliinc's tl^ni ohlaincd 20 t(j 30 years ago. 

Our »>f the dislinguished spe >kers \t the conference yesterday re- 
niindtd ns thai Mark Mav ^nce txpressec? the wish that the IQ had 
neviT heen bor/i. because it liad been so widely n^?sused. Thirty years 
jigo I htNird rrnich sarn. I ind of wish a^.y)?!! ohjecvive t ^sts in general. 
It woulfl b(» rnorr logi<*al. if one insists on making drastic wishes, to 
wish lliat Ihosr guilty (»f misusing test results h'td never been born. 
F*>ul siiur I hi* shortngt* of tfafhers is already alarming, such wishful 
dfpopniatif)!! siiould in* avouh-d. U would he more constructive as well 
as rnorr lof^ical to try to provide more ade(piate edu'-ation on the in- 
terpretatif>n and !ise i)i all kinds of guidafice data, with sp-A ial em|)hasis 
on tin* hrnilations as well »is th(* values of each kind of data. 

In addition to tli** lirnilaliorts and ambiguiti:'s irtherenl in «»v»'ii the 
best existing trsts. the testing movement has, in the opinion of soinr 
wist* and synjpathrtic critics, lost efTectivc contact \>ith the tt^aciiers 
vln), ia last innUsis. an* th»* agents through whom tlie potential values 
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of trst data and other ^'uidaiice iiifoniiatioii must reach the individual 
fiiipils. My distiii;,'uish(Hl colleague. Dr. Lorge, has repeatedly called 
}trrt»iitioii to this gap, and has warned against the possibility that 
r(( hii(>lo;;ic:al advances may tend to widen the gap by concentrating 
all ttstiri^' matters in the hands of specialized experts who are neces- 
sarily rriiuA*^ IVoiii classroom situations, or who at least appear to the 
t«'acli»Ts to \)L' n»mote. 

Sinee pn»pariiig this paper, I was highly gratified to learn that 
Educational Testing,' Service has launched a project aimed at enlarging 
the cla.ssro(»rn teacher's role in student guidance. 

Many statenvide testing programs, as well as several programs made 
avjiilahle on a national basis, are helping to offset this danger. Some of 
Ihr rjirliest of the state testing programs, such as those in Iowa. Mimie- 
sota. South Carolina, Coimecticut, Virginia, New York, Ohio, Wis- 
consin. Florida, Kentucky, and Texas, have regularly been represented 
In this cf)nference. Representatives of more recent statewide programs, 
such as those of Illinois, Michigan, and Tennessee, also contribute 
their ideas to these meetings. These programs have always tried to 
foster close relationships between test specialists and the teachers and 
*rnidaiictr workers in the schools. 

As a concrete example of the kind of continuous testing in guidance 
[jrograms that has always been my chief professional interest, I would 
like to ;:ive yon a brief sketch of the history, operations, and support 
of the i:dncational l^trords Burean. I choose this example because I 
am more familiar with it tliaii with others which illustrate the same 
cmjjiiascs. 

The liiireaa was started during the school year 1927-28 by a small 
^Toup of lifty schools or less which were interested in obtaining objective 
HH-ords on their pupils from year to year. It had a small grant from the 
Keith Fund which enabled it to plan a limited testhig program based 
on ii hud^ret of some twenty thousand dollars. It had no reserve fund, 
ami its llnancial outlook was not promising, even in the eyes of its most 
anirnl supporters. Rut within eight years, all of them depression ycufS, 
this stru;:;,'ling little organization had grown to a membership oif 30(i) 
si'h«>ols. with an aiuiual budget of $65,000 and a reserve fund of about 
$4(1.000. Within another ten years, by 1946-17, the Bureau had, not- 
withstanding the set-back occasioned by World War II, expanded to 
a inemb(>rship of 440 schools, with an annual budget of $150,000 and 
a reserve fimd of approximately $130,000. Nine years later, at the end 
of the s< hool year i9,'j.)-36, the Bureau had a membership of 650 schook 
an annual budget of $270,000, and a reserve fund of around $260,000. 

In 1927-28, the tests scored by the Bureau for its independent school 
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members, which could then sene as a basis of nonns for independent 
s^hr>oK or college preparatory^ pupils totaled just 8.900. Ten years 
later, in 1937-38. a total of 83.400 tests >vere available for independent 
srlicKjl norms: in 1947-18. the number was 112,500. Last year, the 
results of ir>3,(MM) tt-sts were avnihible for use in the norms for the 
independent f mo! group. This number was approximatelv half the 
t(ital nuinb(»r (if tests scored by th(» Bureau for all kinds of iiistitutions. 

What are the reasons for th<- -niw rh of the Ivlucational Records Bu- 
reau, without any attempt to sell its services, and for the growth of other 
similar test service organizations? It seems to me that the basis of this 
development is found in three prcK'edure.s which have constantly been 
emphasized and increasingly put into practice. 

The first of these is continuous testing of every pupil and measure- 
ment of growth in terms understandable to teachers and counselors; 
and analytical reports to the schools, including detailed interpretations 
of their test results. only for class groups but for many of their 
individual pupils. 

The second is (Im» use of coiii|irchensive cumulative records, not of 
Irst results alone, but records arranged in .such a way that test results 
arere|;ite<l to. and interpreted in the light of, much other information 
abiMit individjial pupils. 

The third of th(s<; is continuous research on the values of the tests, 
and publication of tin* results, with the use of as few technical terms as- 
possible, so that the schools would he apprised of both the values and 
the weakiK^ssrs in the instrmnnits used, and would be stimulated to 
ask the test publishers for improved measures. 

Thrse three emphases. uihIct Dr. Traxler's dyn.nnic leadership, maiidv 
account for lUr gratifying growth of the Kducational Mecords Bureau. 

h is a pleasant duty to pay homage to those who are not only advo- 
< aling the pnxhicUnii of better tests but are unceasingly slaving at the 
most difliciilt of Jill tf sting chon^s. that is. the writing of test items that 
with increasing accuracy and fullness measure the dimensions of in- 
telli-rncc. h>arnintr. and fH'rKf»,K,lity that we need to have measured for 
the greater coriM rvaf ion of human resoeirces smd the greater happiness 
of all individuals during and after schoul days. Those whose unremitting 
eir^irts are hriiigiii- us closer to this goal are, in my view, (he rf»al heroes 
of Ihr testing moverr»ent. Mtliough I still occasionally try my hand at 
this basic task, recently even to the point of playing with palindromes 
for a proj<Tte(l language teat, f confess that for many years I have quite 
fallen away from this onerous type of work. My own fall is quite un- 
important, hut I do regret to find (hat. in devoting myself to softer 
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kinds of jobs, I am still not without good company from the ranks of 
former test makers! 

While offering homage to the many devoted workers hi various 
programs and in various institutions, it is a particular pleasure to con- 
gratulate President Chauncey and his staff in Educational Testing 
Service on their leadership, on the high professional level at which their 
test construction is being done, and on their broad research program, 
which amply justify the high hopes of the architects, founders and 
supporters of Educational Testing Service. 

My concluding remarks may be epitomized by reminding you that 
the cumulative educational record form which we prepared for the 
American Council on Education in 1928 allocated more than three- 
fourths of its space to information other than test results. This propor- 
tion in the allocation of space to records of behavior other than on 
paper-and-pencil tests still seerns reasonable to me. I have neither the 
time nor the talent to discuss Ludwig Bolk^s conclusion that in the proc- 
ess of human evolution Man had been arrested at the level of growth 
of the embryo of an ape, or the more recent argument of Lucien Cuenot 
that Man is "an example of neoteny in a chimpanzee or gorilla," or 
the still more recent opinion of Professor Carleton S. Coon that "The 
Neolithic mentality is still with us in most of the world, a social co- 
elacanth on the beach of time and an impediment to global peace and 
unity." But we do not need the authority of these gifted students of 
anthropology and evolution to convince us of the critical importance 
of devoting more time and effort to the study of human behavior. Since 
one of the most productive workers in our field in now heading a project 
in the behavioral sciences, I would like to express the confident hope, 
which I am sure we all share, that Ralph Tyler and other students of 
human behavior will forge ahead far enough to improve Man's basic 
r^ncation, and fast enough for Man's survival through the age of the 
hydrogen bomb. 
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Participants xj xr 

Robert G. Bemreuter, Richard Hill Byrne, S. S. Dunn, Hanna t, 
Faterson, Warren G. Findley, John C. Flanagan, E. Z. Friedenberg, 
Newman L. Hoopingarner, Morris Krugman, Irving Lorge, James L. 
MacKay, Gardner Murphy, Edward Silverberg. 

DR. MacKAY: It looks to me as though Dr. Murphy was just burst- 
ing with some things to say during that hist paper. I wonder if he was. 

CHAIRMAN LORGE: They are doing personality appraisals out 
there in the audience. 

DR. MURPHY: I thiiik Dr. MacKay saw me taking notes. I can 
throw this either to you or Dr. Krugman, depending on the mood. I 
wonder if I was more optimistic or less nihilistic about the actual state 
of personality testing. ^ 

It might be interesting to see what you think of the realistic pos- 
sibilities of four types of things I put down. First, what do we think 
about following one projective test sysleinatically with procedural 
variations within a population with new types of cross-checks year by 
year, the w:»y MeClelhind has nsod the TAT? Should we say this is 
simply a way of testing u test, or should we conehide that something 
ahf)ut the basic validity of our personality theory is obtainable from 
this sort of thing? . . 

Second, what do we think about the attempts to develop projective 
trsts into a more standardized and objective form, like the attempt of 
Wayne llollzman today that we make the Rorschach into a systematic 
und pretty objective test? Third, what do we think about the success 
of Witkin and his collaborators in systematic comparison of experi- 
mental procedures with projective procedures? I have particularly in 
mind your life situation of children in relation to field dependence. 

Fourth, what do we think of straight laboratory procedures, like 
( Jeorge Klein's studies, as ways of getting at personahty dimensions 
under tightly systematic safeguarding of experimental procedures? 

Would you be willing to take a minute or two and talk on one of 
!liost>? 

DR. KRUGMAN: We are here for the rest of the day. First, I hope 
I (lid not appear nihilistic. I was trying to present my own experience 
and the feeling of many people that the simple approaches to personality 
do not yield the desired results. I hope I am optimistic about training 
clinicians, using all the knowledge of the basic sciences and all of their 
training, using the best method of research, combining the two and 
not looking for scores or quotients or profiles or simple techniques, but 
looking at personality and its complexity. 
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Ia I's siiy in this situation as in the study you mentioned earlier, 
Dr, Murphy, that the teaching situation or the graduate student situ- 
ation is considered in rehition to certain members of the faculty. The 
question becomes: How do these students react to particular faculty 
members in particular situations? 

In any approach, the follow-through systematically and chrono- 
logically is the kind of approach we are all pleading for and hoping for, 
rather than tlu? panacea to give us a very rapid picture, or give us 
nothing at all in the ultimate. 

CHAIRMAN LOIIGE: I would like to suggest that some of the 
questions Dr. Murphy lias proposed are questions thai some of you 
ought to discuss. I would like to remind you that F. L, Wells, in his 
textbook, put a tremendous amount of emphasis on tlie Army Alpha, 
not so much on the test, but rather in the course of working with many 
individuals over many years he developed an uiiderstanding and a feel 
«)f how Alpha wt^nt with certain kinds of broad behaviors. The very 
fact that the test went with broad behaviors suggested that Alpha was 
a useful instrument. He found dilliculty in communicating his ideas 
nboMl Alpha to other clinicians. 

I'he problem boconn's one of why are such intuitive and valid judg- 
ments so diflicult to transmit.^ The test maker has been working over 
the years trying to lind an instrumenl which will simplify diagnosis in 
terms of interpretation. I think the line suggested is one that would be 
of great value. If you worked with the same test with many individuals 
and made conscientious follow-ups. you would be surprised at how much 
you could learn. 

.\re there further (|uestions or discussions.^ 

DM. HI'.RNRK[;TER: I have recently madtTl^ery crude estimate 
of the number of people who would be njcjuired to carry out psycho- 
logical services that seemed to be demanded by the general populace 
in America. A very crude estimate indicates practically every person 
in Amijrica with an IQ over 130 would be required in the held of psy- 
cliology if all the work that needs to he done is to be done by people 
with Ph.D. degrees. That, to me. is a very s<jbering fact. I am not at 
all in sympathy with the concept that says you should not try to 
develop an instrument that ran be used hy a person who does not have 
a Ph.D. degree. I think it is extremely important to us that we do have 
instruments that can l)c used by assistants. 

I think that when the younger people in our profession are given the 
impression that it is foolhardy or unwise to work on an instrument that 
can be used by soiiumjuc without a Ph.D. degree they are being misled. 
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I thiiik a disaervice is being done to psychology when any young person 
is di&^ouraged from attempting to work in a field which would result 
in an instrument that could be used by someone without a Ph.D. degree. 

CHAIRMAN LORGE: I have one hope that people like Bob will 
have taken their own tests systematically at two-year intervals to see 
what the impact of the external situation is on the internal dynamics. 

DU. FRIEDENBERG: I would like to address this to Dr. Murphy, 
w hethtT he sees any specific promise in the sort of approach that William 
Stephenson has published and advocated. It seems to me that in that 
you do have a systematic way of going about two of the specific goals 
that you mentioned, one, designing the external situation into your 
experimental study so that you are, in fact, examining an interaction 
rather than a set of traits, and two, providing a basis for examining 
vfMir orthogonal effects, so tliat they just donH crop up out of the data, 
but in response to Jiypotlieses tliat are included in your experimental 
design. 

DR. MUIUMI Y: I am very sympathetic and very enthusiastic about 
this approach. I think it is relatively untried, but it makes a lot of sense 
in offering an opportunity for clinical people to get together with 
sophisticated non-cUnical people in a procedural way, and work back 
and forth. They learn a lot from each other. I have seen this work where 
the statisticiails were rather naive clinically and the clinicians naive 
.statistically. 

DR. BYRNE: I address this question to Dr. Krugman. I wonder if 
he has any coimnent to make about Meehl s recent work in wliich he 
says, I think this would be a safe generalization to make, that when it 
comes to statistical or clinical prediction, the statistical operator can 
predict personality as well as or better than the clinician. I gather Dr. 
Krugman was perliaps being negative about the statistical approach 
through the use of present measurements, and was favoring a greater 
emphasis on the clinica' ^ roach. 

I wonder if you woiiK: hiw ' a comment about MeehPs study. 

DH. KRl (iMAN: \^ r . uol at all sure that the statistical approach 
-ives us a better diagnosis or a better picture of personaUty. What we 
are sure of is that, u.sing the criteria established statistically, we seem 
to -et better results if the test user is clinically trained. I say we are 
just as weak in the clinical field as in the other, and I am not defendmg 
it. The point I make is that we have no evidence that in either case 
we have really been able to appraise personality to the others satis- 
faction on a group basis. i 
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Apparently in the (.'liiiic .situation, when the tliiiician correlates data, 
not mathematically but on a ease to case basis, with the judgment of 
the clinician, with the judgment of the life situation, with the total case 
study, and with prognosis in terms of what happens to a specific indi- 
vidual—of course wc are faced witli disturbed individuals, too— it 
seems to stand up a little better (han simple instruments, but that 
isn't saying very nnuh. 

Obviously, w<j have not reached our goals in either category, and 
nnjch more work needs (o he dour, I cannot accept the proposition so 
far that anybody has developed any clinical insd iiniunt tliat gives you 
complete satisfaction when used with groups. 

The Kyseiik study of therapeutic procedures, you will recall, proved 
that it doesn't make nmch dillerence whether the therapy is done by a 
general practilirmer, psychologist, psychiatrist or psychoanalyst, the 
net result secmt-d to be the same. In research, the chnical approach 
often fares no belter than the slalislical. 

CHAIRMAN LORGK: The antagonists in the argument "statistical 
versus the clinical" ought to iriclude in the family the matliematical 
srali.stieians. They have not yet given us methods of relating a complex 
diagnostic indicator to complex criteria, i.e., our criteria are not yet 
fvstablishud. Any time that anybody takes a simplex criterion, such as 
success, adjustment, duration of therapy, and takes a number of vari- 
ables to relate them to such a simplex, you will find that the statistics 
are necessarily inadequate Ixrause the method is multiple correlation, 
ff, however, you were to ask "what about a complex criterion.^" (which 
is what life is), it isn't simple. This proposes a problem for which we 
do not have the tools, we seem to lack the requisite methods. That is. 
we need something that goes beyond our current conceptionalization 
of mind. This is where Dr. Mnrphy\s presentation is so germane, because 
it does give ns certain indication f)f direction. 

I think in the same terms Dr. Krngmairs statement to us is, "where 
are we and what are the possibilities for going some place else?'' I am 
sure that in this audience there nmst be people who have thought as 
Dr. Krugman and Dr. Murphy have, who have more positive things t(» 
say than hav(^ already been said. 

DM. FLAN A(; AN: In searching for criteria for use in prediction 
studies in a variety of fields including educational achievement, military 
and civilian aviation, and children's personal and social development. 
I have come to the conclusion that Sir Francis Galton's idea proposed 
nearly eighty years ago is a very sound on(^ He proposed that we make 
daily observations on peoples behavior, and that these be described 
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ijH objorlivrly iis i><)ssil»!»' in wrillrn records and labulnlions. Tlirnuf^h 
th«' UH<- of such >>-»t'mjiliriilly <ollroled perforiiiaiire records a truly 
valitl and pndii l;ihh' rv'iU rmi ran be obtained. By maintaining ihasv 
rironis in a form in wliirh the inferences of the observer are redm i'd 
t(i a niiniinuni v^e have the ba^is for deveh>pin{? a set of useful inslrn- 
nit nts thiit Ihr ytHni^tT psyt la>h)Kisls eaii use for pn-diclion sindirs 
involviiii^' whalrviT viirielv of pHMcdure ihey rUnnsv Ui use wla lhrr it 
tw objcrtivr. proji r! ivc. or subje< tive, 

DIl. FINDI r.V: \s I have HsIeiiHl to ihr ^prjikns, Ihey all srrin 
to hr a^'rmi that this mailt r t»f appraising and (h :iling wilh prrsDnalily 
is v^ry r(^inph'\. I M lhal wr iirc now reac hing a conclusion thai ihis 
rorn|)lr\ily of ;ippr rising personality wilh lesis \rrges on Ihe order of 
Ihr ronipicxily of a problnn that we haveift done mia h al)Out. >*hat 
I >v<Mil(l t Jill \hr area of prevenlive menial lieallh programs. I wonder 
whellier one of t)i< eorH-lasioits might be, not the taie tliat Dr. P.ern- 
renler has sugg*st*'<l. of going on. si riving valianlly lo make more and 
Ih'II.t rnrjisiires lhan r:m be used by persons wilh less facility, bul 
perhaps trying In eonunmiicate lo a larger and larger b<Kly of scIi(k>1 
adminislralurs. si1hk>1 letirhers. parenls and others. Ihe rudimenls of 
Ihe itiens alMMil pervniidilv lli-'^^ seeni \o iniderlie our dinieully in 
making simple inslrmncal^. 

I wontler if either of the speakers wonhi rare to «'onanenl on lhal as 
:«n ;ihernalive appnKieh. 

DM. KlU (iM \N: There yon inject quite a dillerent problem. There 
,il\s.jys will Im' 111** problem ttf diagftusis regardless of how much preven- 
tion is done. My eommcrit wn lh;»l e|ueslion w(nd<l be v)nielhing like 
lliis: That in this lidd of |H'rs*>nalily appraisiil, w<' are probably now at 
the st.ig.' where physics was bcn)re tin* atlvei.t of nlomic physics. We 
thought we knew exactly what matter was; we knew it ha<l its limita- 
tions, it was static anti stable. Siuhb^rdy we are in an upheaval. All our 
notions are dis|V'lle<l, ;»nd matter isn't at all what it was. 

I think right nf)W weareat thenpenii!g(.f an era where wearebegimang 
to umlerstiuui a little more about what persoimlity is, and from tliat. 
1 think, will stem tM»tter appn«irlies to the measurement of personality. 

hir KVTl'.nSON: (Joing back lo a |M)int rais^'ii previously. I am 
<ine of those soft.lieruh'ii |vsycliologist^ who feel that a g*HKl deal ran be 
|eiirin'<l from proj<Ttive tethniques. not ortly alnait the person wilh 
whom one is working, but alsoaUmt the insirument which one is using. 

Dr. Lorge made a connneiil aUait Dr. F. L. Wells feeling that v\ru 
Ihe Amiy Alpha was an instrument with which you ciiuld learn more 
about piTJions- It seems to ine that one dilTiculty with many of the 
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stijilirs on tfii* vjili<lity (){ projtx'tivf \i*sls which arr <'oiitimi.j||> hrlii^' 
n f>ort<'il is thiit such studies so often bc;;in with a iiicchaniriil ii|*pli< a- 
tioii of tra<]ilioita! s<'oriii|i; s<hciiieii and iiitcrprctations A/r einmidc, 
ntrn*ltiiuitj Ihe color srnre nn the llorschach ivtlh rulings (ff "esfran'rsum,'' 
unti findifuj. us ini<jhl fte experled, lillle or no relnlimshifi. 

Nor ih> I i' t l thai a Pfi I). d< «;nf is any ^Miarantrr uf ihc \v\A of 
\»\ v[n\\\\ri\, I Mill n iiiiiidt^J of a I'h.l). stuth-nt jif Dr. Kriijiinaii's 
iolil inr I know \\\\ alxMit the Morschach. 1 had a course with Dr. 
Kni;;rii;ifi " I am rt jilly quite eonec rii-d about the attitude of uiany 
viMUi;: |»» n|»l<- rnlt rin;: the Held. Soiueho.v, ju tht* c<jurs<' of their traiiiiii'; 
ifi ( liiiii ai work with proj<i tive teehtu<|ues, they deveh)p the nttitude 
ili.it "Ih* n' arr ( rrtiuri thiii^rs to he learned; I will learn theni. and use 
llirni.'' More en ili\r peopir who have gone more deeply into[. ^ ;»'<'tive 
Irs Is. or p"^»ph- who have us«d objr< live tests Iw tlir way in w.jiJi Dr. 
Wrlls usiil thr \ifii> Alpha, are in a position 1o look for new ways of 
undrrstaiidio;; Ihi- material, and thus to put validation studies on a 
mon* sabstanliai hii>is. 

In n adin;: publi^hrd reports of v:didaliou sludi. s. I mu also often 
di^hn hrd h> lln f.irl lhat intrrpn tat ions madf Ln p.>\eliol(j^'ists of ver\ 
\arii d Icvi ls of ( oinpeteiM r an<l insi;,'lit fire |XM)le<J top'ther. The r^ sulls 
ini-hl iM'rhap.s be diirirrnt if psycholo<:isls si'livUnl for sublhly of 
uiuler^l.iridirn: and llexihihiy of approarh served as iaterprelt-rs. If the 
<pii ^lion i;l ( ril riii aU * n-criv* J srrious atlmlion. wr would hr on the 
wa\ to hrtliT <h"«iLMH'<l validation stn<li« >.. 

DIt. ll<M)nN(;\HM;n: n ..^h. Io mr thai our of tl.r mn.t 
>.riii».il ^ti p-v to hv l.'kt'u Id pn»\«' iIh- \;iljdil\ of (rsis and ia>>lnmirirU 
fiH rlM < kin;; and i'\ ihialin:^' pri ^orialil \ should br spceilii- r('>«';iri h \ \ 
i'^t.d>li>h I rilrria .»ri what wr rni;:hl l all \* \\ broadix sun- s i,r snfis- 
fitrfnry hrttuj. livru IhniiL'h Wi- mi;:lil liavr lo rli;ui;;e our* ritrria from 
limr ti> tim«' wr wotild liavr ^omt lhiri;; that at IimM Wiis drliiitd as 

♦ J I\ -'^ fH>^^il»l.-. ,oid b\ rhrrkin:: oiu' variuus iuslrnuHMits a;:ain>.! 

llii-^»- « litt-ria w«' Would lia\i' >.nrtp' >.tau(|ardi/ation. sotui' p'al l>a>is for 
I UMpoixMi and M,rn<' |ji^i> for jiidi;tnrnl us lo how \alu;d>''' (he !«'>! 
i«'>ull^ art*. 

\^ I >r»' if. lhi'r«' li i> 11 brt'ii \ri\ rnii' h aecMmplixlird in lh»' ua\ nl 
I'^labli^liin:; an> >ort of rritfrion. or rrilrria. to jud;;r l>v. l'»i*for»* wr 
rarr maki- an> ::r»Ml .unoinit nf pru^jrrss i hi lh»'rt' UmI be sfinirlhiiii; 
firlitjili' (haie tn i ^1 d)liNh < ritrria fnr w. like lo <aH sntrtss'.^ 

DM. |)l \\: I ;m, wotidirifi;; whilht- .iie speakers wnnld rari' to 
ei»rnnr» rit «»fi thr idt a Di it iii^h-ad of srtlin;; up c riterion, wr nii;:!it often 
a: r#'pf th»- test S4 nrrs an adf^pn»te measure and start to vary the 
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situiilioii and s;iy tliiit we uiulfnslaiid what happens when you vary- 
tlu» situation and reuse the sign test. I think where you mate a reading 
Ij'st, you make some sfirt of change in the reading techniques and then 
n»use the sign lest, and you will get a better understanding of the 
reading process. Wtmldn't it be possible in personality not to talk abcHif 
some sort of external rriteriun, but to use the test its<»lf and the shifts 
in the U^i and vary the situation so that in that way there is a better 
understanding} 

DH. Mrni'IlV: That is what I had in mind in referring to McClel- 
larurs work, which I believe is an example of the suggested procedure. 

MIX. SILVI;MBKHG: Ilaven't we readied the stage in the field of 
personality study, where wi» could approach these problems more 
maturely by s»»tlinj; up an organization or foundation, to do the same 
job for us that similar fuuiidations have aeeoniplished in other areas.^ 
riiis orgunizaliou rould set up many series of studies using cross- 
dis< ipliiie and tliroretieiari-practitioner teams. Studies could be assigned 
arbitrarily to institutions, with assigned goals and periods of duration. 
I sing our own ric h hmnan resources, we can then follow these studies 
over years of testing and practice, and arrive at more valid conclusions 
than we seem to be arriving at now. 

CIIAIHMAN U)IU;K: This is a suggc-sticm that 1 think 1 made: 
a man ought to trst himself. When I was naive and young I rated myself 
on a large munber of aptitudes, because I thought I would get a fellow- 
ship at Stanford. I never sent the application, but every two years 
I rated mys«»lf. I want to tell you by my self-appraisal I made progress. 

The sngg^^s^i^ln is recast »nabh»; if we could ordy follow-up the behavior 
<if youngsters, nr uMstrrs. as the case may be. who have been tested, 
we may get a ijoikJ deal of information. The difllculty is that this in- 
foriiiatiuii is nwt easily acirssihie. 

I have a si t rtvords on the Strong Interest Hhink. from a group of 
\\V\ workers, wfio tcM)k the blank a week apart, thirty days apart, a 
year apjirt. twt) years apart, and then WPA went apart. Yet there is 
sometliing in n rords of |xit<'ntial significance, e.g.. consistency 

over time, ovrr tin* span, whieli is astonishing. Sixty-si.x per cent of the 
items are relatively unehange<J over time. 

We havr the suggestion that Dr. Mijr[>hy has made to us. ll»at this 
is one way. folluwing the same instrument in a Itmgitudinal study in 
wlii^h yf)n ask what happens to the instrument.^ The other approaeb 
is to use the i!istrument as Mc( .l» lland d(M'S to see what happens 1o the 
iiistrunienl as a roiisi'fpjence of changes in ciuidition^ This is essentially 
\Khnt Skimi»T is doing, lie tak<>s a given method and keeps on working 
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with it until he can understand it fally. That is Skinner's methodology; 
if used the way he is using it and the way other people are using it» you 
will know much more about how people behave in a specific problem. 

Are there any other comments for the good of the cause? May I then 
thank both Dr. Murphy and Dr. Krugnmn for the wisdom that they 
have given us. 
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Any elTort to review (he developiiieril duriug the past fifty years of 
the school currieulum of (he United States encounters a confusing 
conjplexity. This is not due alone, or even primarily, to the fact that 
we have no centralized coiUrol of education in this country, although 
it is true that the variations among the forty-eight states are easily 
marked. These K^cal variations are less pronounced than are (he dif- 
ferences of another sort. 

One may analyze the development of curriculum theory, that is, the 
s(atenieiits of rationale for (he curriculum and the related discussions 
wliieh seek to explain it and to make it more cohermt and systematic. 
( )nt' may examine the work of the pers<jns and grou{^^io have designed 
courses of study and prepartxl curriculum guides. OM may assemble 
rrports of the curriculum in operation in certain schools to obtain a 
picture of what teachers are actually (eaoliiiig at a given time in the 
few soIkxjIs on which this kind of report is available. These three reviews 
will give quite dilfereiU e()n(ent. yet each is a significant aspect of the 
American school curriculum. 

Another factor in the compkv\i(y of (his topic arises from the un- 
usually comprehensive defini(ion of (he (erm "curriculum" which is 
currently einployt^l in American educa(iona! circles. The term is not 
limited in this conn(ry. as it commonly is abroad, to refer to the outline 
of the con(ent to b' taught but is used to include all of the learning of 
students which is plaimed by and directed by the school to attain its 
educational goids. This inclusive definition covers the formulation of 
itlucational obj(H:(ives. (he planning, use and organization of learning 
e.\perienc<»s, and the apprai.siil of student learning. It also includes not 
only the learning ae(ivities carried on in the classroom and laboratory 
hut aLw^ those at home or in extra-curriculum situations insofar as these 
are plaimed and direc(e<l by the school to attain its aims. The line drawn 
iM'tween the curriculum and other activities of the students is that which 
H'parates activities designed by (he school to contribute to educational 
ends from thf*se which are provided for recreation or for other purposes 
or are not part of the schools plan. It is true that the current definition 
of the curriculum is a more adcM^jnate one for thinking about, for planning 
and for conducting an wlucational program, but it does mean that a 
review of the curriculum must include a larger range of matters than 
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would be required if the definition were limited to the outline of content 
t(j be taught. 

To brinfe' my tiisk into innnnge.ible si/.v, I li;ive chosen to focus atten- 
tion on the development of rurrieulnm tlieory over the past fifty years 
with (Kcusionul comments on tlie wnys in wliicli eourst-s of study and 
curriculum guides diverge fr(»ni flic accepted rutitjuah; and with still 
fewer (Kcasiorud connnents on tlie di>crcpancies between teaching prac- 
ti<'es and curriculum tlieory. losimplily this complex review still further, 
we shall examine each of three major aspects of the curriculum in turn, 
treating the formulation of educational obje( tivi's. the selection of 
learning experiences, and tln' (jrganization of learning experiences. .\l- 
though the evaluation of the elFectiveiiess of the curriculum is commonly 
included as an aspect of the ( urriculiim itself. I shall not discruss it since 
the two following papers deal with this subject. 

arfrtululiofi i*J Ediivuiiafuil Ohjeciives 

A major sli p in ni;)st theories of curriculum development is the 
l'i>rniiii;ttion of llu' cdiK alional ohjeciives of the school, that is. the 
goals to be attaint (I b> its edni aliorial program. To be sure, this is not 
an appropriate step in John Dewey's educ ational philosophy in which the 
diiiction of learning is guided by (arefiil consideration of the (piality 
of the learning experiences. Insofar as the learning experiences fjrovide 
lor continuity and interaction, in Dewey's terms th(» program i.s elfective. 
His philosophy does not involve a distiru tion between ends and means. 
Hut the othtT chief headers of American curriculum thought emphasize 
the im|M)rtance of dear objw tives as tlit» basis f(jr planning the learning 
experiences and apprai>ing the results. 

Since the turn of the i entiiry iIktc have been several marked changes 
connected with tlie formnlatieHi of (he objectives of the scIkk>I. One of 
the most (»bvioiis has hvvw the cliangi-*! conception of the nature of 
educational objectives. The dominant educational psychology in 1900 
was based i>n the theory u[ formal discipline and expressed in terms of 
•faculty psychology. " Tfir mind had ciTlain faculties sen h as nicm(jr\ 
and reas<in which could be trainee! or disciplined by proper exercise. 
'Hie objectives of the s< IkmjI witc slated in terms of the facul.ivs to be 
trained, and the learning >'\perit»nc(»s wen» thost* exercises m whico th<se 
faculties were engag<^l on content particularly rich in opportunities for 
meiiiori/ation. re»s<)ning. and the like. Certain .subjects by the very 
natiin* of their form and content were superior means f(»r cultivation 
of these faculties. Language, particularly Latin, for example, was a 
sujH-rior subjcrt h«rause the learning of it required the exercise of 
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nrH»riiory, while its grammatical structure provided exercise in orderly 
reasoning. 

With the decreasing acceptance of the theory of formal dis* ipliue 
and the elimination of faculty psychology, the prevailing view he<:aine 
increasingly b(»havioral. Learning was then conceivt»d as the acf|uisition 
of pill terns of behavior which thf slu(h*nt had not previously followed. 
Human b<'havior was defined (piilr g» iierally to include all the reactions 
of an individual, his thinking, IVi ling, acting. 

Kdncational ohjt^ctives iiri' im»\v rouchrd in behavioral terms. An 
objeclive is u statement of a kind (A' behuvior p;ilteru which the school 
seeks to have the student develop. In the first flush of behavioral con- 
cfpls, roughly from 1918 to 192.). the objectives were conmionly stated 
in highly specific terms, such as ability to add 2 [)his 3. abiliJy to use 
Ihe indefinite article "an." ability to spell * believe/' ability l(j rt^all 
the atomic weight of sulphur. This was a iiMlar^l corollary to <hc pre- 
vailing associationist theory in the psychology of iearniri^'. Kvery 
number coiubinalion. for exjuuple. was viewvd as a diflerciit stiumlus 
lo which the student was to li :un an appropriate nsponse. This extreme 
view led to the listing of nearly three Ihousiuid spcx'iiie objtxtives for 
arithim lic. and nearly two Ihousiind lor luiglish. A student had attained 
the goals of Ihe ( urriculum when he had learned to make the appropriate 
respiiiises lo all of Uu? specific sliimili, that is. when all of these in- 
rau;';erahlf objectives had bt en reaclKxI. 

By 192.). ihis view (»f objectives had largely fallen uf its own weight. 
On Ihe side of Ihe teacher it required keeping in mind far t(K> many 
goals to be reinembt'red. and on llu» side of the student, it denied the 
developmeiil of generalized l)ehavi(>r patterns whidi quite obviously 
were developing. The fornuilation of other theories of learning whirh 
l<Kik into acciMint the pht riomeiion of geni»r;dize(l behavior provided 
terms in which educational objectives have connuonly been stated since 
1930. For example, in 1936 the Deparlmenl of Superintendence of th(» 
National lulucalion Asstxialion published a yearbook on •Tin* S<H'ial 
Studies Currit-uhun.'" Among iheobjeclivessaggesled were: (pp. 320-310) 

1. Acrpiisilion of impM>rtant informalion 

2. F^aniiliarily with t<rlmical vtKubulary 

3. Familiarity with dependable soun es of information on current 

MXMul issues 

4. Inmuinily to malicious propagaiuhi 

5. Fsicilily in interpreting sin ial science data 

6. Facility in applying siguilicinl fai ls and principles to stnial 

problems of daily life 

7. Skill in investigating sf)cial s< ience prol)lems 
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8. Interest in reading about scx;ial problems and in discussing them 

9. Sensitivity to current socinl problems 

10. Interest in human welfare 

11. The habit of working cooperatively with others 

12. The habit of collecting and considering appropriate evidence be- 

fore making important social decisions 

13. Attitudes favorable to social improvement 

These obviously present a conception of generalized behavior. How- 
ever, although they avoid the piecemeal aims of highly specific objec- 
tives, they may be as limited in their value for guiding teaching as the 
earlier statements o{ objectives in terms of faculties to be developed 
unless each of these thirteen objectives is clearly enough defined to 
have meaning for the teacher so that he can easily think of concrete 
illusLrations of the general aims. Tlie developments since 1935 in the 
conception of the nature of educational objectives have largely focused 
on deliiiing in concrete terms aims which are expressed at a similar 
lev(*l of fjenenility as those above. These elForts have been applied to 
deJining the kind of behavior implied by such general terms as "under- 
standing/* "applying principles to concrete problems,** **ability to 
iiiter])P't reading material/* and to indicating the range of content to 
which each kind of behavior is to be lipplied. Thus, the (Ajective **to 
develop understanding of the basic concepts of physiology** has been 
defined from the standpoint of behavior and of content. The behavior 
'"understanding" is defined as **lhe ability to recall the concepts, to 
stale them in one's own words, to give illustrations of them, to recognize 
illustrations given by others, and to compare and contrast related con- 
cepts.** The content termed "the basic concepts of physiology" is defined 
by listing some two siore concepts which these curriculum makers have 
seh»cte<l as basic to this science. This kind of definition helps greatly 
to clarify the aims of the cnrrirnlum so that they can actnally be 
ntilize<I in planning and conducting an educational program in terms 
of the prevailing conception of the psychology of learning. 

A second marktxl change in the objectives of iJiu An^ 'rican school 
( iirricidnm has been in the sonrces used to derive the nu js. To some 
extent all of the five major sources Iiave been used " ;:>criod of 

American history but at a given lime certain sour.; v ;V!!«nant in 
their influence while others are given only minor att'jntion. Between 
1900 and 1918. the judgments of subject specialists and the prevailing 
conception of the psychology of learning were dominant in formulating 
objei^tives. At the high sch<X)l level, the Commillee of Ten used sub- 
committees of mathematicians, historians, language scholars, and the 
like to onlhne the objectives of secondary school instruction in these 
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fields. Althoufj'h thr pi availing educational philosophy akeady 
emphasized knowledge and skill for the layman as a major aim of the 
Ainerioan high school, this was given litllo attention in deciding on 
ohjectives. No studies were made of the needs of society nor of the 
needs of students to help in identifying appropriate objectives. 

As a result of the success of job analysis in building vocational cur- 
rirnhi during World War I, the pnx:ess of formulating objectives from 
to 1933 leaned heavily upon job analyses, activity analyses, word 
couuts and other techniques for identifying the demands made on the 
individual by contemporary social life. At this time, curriculum makers 
also gave' attention to the notions of educational psychologists as to 
what hehaviors ronld be taught. However, during this period Httle 
attention \n,is given to the |»revailiiig s(x:ial and educational philosophy 
regarding the eharat teristics of the g(Mxl man and the good society. The 
opinions of suhjcvt .specialists were given much less weight than in the 
previous period. 

From 1933 to 1' t,>» studies of (children and youth .served as a major 
source of snggestioi.n for objectives. With an einpliasis upon the re- 
spon.sil)ility of the s<'h(K)l for meeting the need.s of children and youth, 
eurri(;ulum commissions drew upon (^hild study data and reports of 
adolescent studies to derive objectives. This largely coincided with the 
prevailing emphasis in educational philo.sopliy and to some extent the 
work of edn( alional psychologists was u.sed. But the use of studies of 
social demands was notably less than in the decade previous wliilc the 
opinions of snhjert specialists played a very minor role. 

Since the Second World War, the .shift in empha.sis among the five 
kinds of sources has l)een marked. Primary attention is currently given 
to the opinions of subje<:t specialists, particularly in mathematics and 
s<irnce. Very little weight is currently given to studies of the learner, 
but the spe< ialists are asked to outhne what they believe to he important 
fM>teiitial contributions of their lields which will be of value to laymen 
as Wi ll as persons plaiming to .sp<»cialize in the field. In this respect the 
• inphasis is dilFerent from that in 1900. Today some attention is also 
being givrn to an examination of s(xrial demands, and to a lesser extent 
to the rurrent conception of the psychology of learning. Much less u.se 
is made t^nlay of studies of the learner than was true fifteen years ago. 
In general, the shifts which have taken place in the primary sources 
used to ''txive educational objectives most clo.s<*ly parallel the changes 
whieh can lasily he sem it) the stat(?ments of objectives appearing in 
course-* of study and in eurriculuni guides, n^^nuse the actual practice 
of tea< hing depends so liirgely on the habits and outlooks of the thousands 
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of American school teachers, the shifts in practice are not so easily 
discerned. 

A third marked change has been in the range of objectives which the 
American sch(xjls have not only accepted for themselves but have 
actively championed. At the turn of the century there was a sharp 
difference between the claims made regarding the schools' general con- 
tribution in promoting citizenship and character and the working 
objectives of the curricuhiin which were focused on knowledge and 
skills and inlelloctual discipline. The development of many basic atti- 
tudes, values, interests and habits was recognized as a primary function 
of the home and church, and for those habits, attitudes and skills 
relevant to work the employer was expected to play a strong role. The 
si^hool today coininonly lists the whole range of educational goals re- 
quired for the induction of young people into effective adulthood. It 
includes ohj<»<'tives relating to home life, personal-social relations, civic 
life, occupations, and the like. It includes not only knowledge and 
intellectual ;ihilities but interests, attitudes, social and recreational 
skills. Fre<inenlly, too, there is no indication of relative weighting. 
Developing social skills and a cooperative attitude appear to be viewed 
as jobs as important for the school as developing understanding of 
basic Cf)n('epls of science and the social studies or the acquisition of 
the skills involved in reading. 

Since the level of learning required of people today is a high one, a 
major problem in education is to select wisely among all the possible 
goals the important tasks which the scliool can do well and to con- 
centrate its enrrgies effectively. Since the total educational job is very 
great, the home, the church, the employer and the other potential 
educative agencies of thecomnnmity net»d to be encouraged and strength- 
ened to take their share while the school concentrates on the things it 
can do best, and in many cases the things that only the school can do. 
IIenci\ the present shift in school objectives is toward a more dis- 
crinnnating selection, toward the kinds of learning which involve intel- 
lectual skills, which require sequential experiences to reach the necessary 
level of competence, w hich involve concepts and principles that are not 
npparent on the surface and for this reason are not likely to be learned 
through the guidance of hiymen. This shift is likely to reduce the great 
range of ohj<-ctives, ;uid to diminish the emphasis upon social adjust- 
ment and similar go. Is which fail to recognize the importance of in« 
dividualily and iiidivicJual creativity in responding to experiences and 
ill solving problems. The increasing emphasis upon understanding and 
thinking as kinds of objectives, with lessened stress upon attitudes and 
habits as primary goals, may help to revive the conception of the 
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individual who controls liis feelings and actions in terms of his knowledge 
tiiid thought rather than one who simply seeks to express "acceptable" 
attitudes and feelings and to do the **proper" thing. This is a shift in 
objectives which will be interesting to observe. 



Among the changes takin«^ place* in the learning: (rxperieiu^es provided 
by the American schools, those in the prevailing notions of the nature 
of learning experiences are particularly signilieant. At the beginning of 
this century, the term was not used. Exercises, assignments, examples, 
problems were the words commonly employed to designate the learning 
tasks set for students outside of the class session, while the term "reci- 
tation" was used to refer to the oral responses expected of the student 
in the class. No mention was made of the student's mental reactions 
in the class, ii I though it was riear that he was expected to pay attention, 
that is, to watch and listen to the teacher's presentations. When I began 
to teach more than thirty-live years ago. we had to file lesson plans for 
each week in advamn*. These plans outlined the content to be covered, 
what the teacher expected to do and the out-of-class assignments to 
be made. The focus of planning was on the teacher. 

John Dewey and other educational leaders gave wide publicity to 
the increasing psychological evidence that learning con Id be most readily 
interpreted in terms of what the learner was doing. It wa$, his reactions 
that he learnfxl — not the teacher's. The teacher's role was to stimulate, 
guide and njward the learner as he carried on the behavior which the 
school sought to teach him. This view placed attention upon the ac- 
tivity of the learner as J he basic factor in attaining educational ^coals. 
By 1925, both writings of theorists and currieiihim guides were com- 
monly using the term * 'learning activities" to refer to the basic elements 
of the teaching-learning situation. ( '.ouf'' )s of study were Hsting reading 
activities, listening activities, study activities and laboratory activities 
in outlining the day-by-dny program of the school. 

By 1933, cnrricnhnn writers were pointing out certain hmitations in 
concept of h'arniiig activity. For exainph;, two students might both 

reading an historic account of ihr California **Gold Rush,'* yet each 
might be carrying on quite dinVrent mental reactions and making 
dillerent emotional responses. One might be thinking of the excitement 
and challenge involved in the long wagon haul the pioneers made in 
crossing the country, thrilling himself as he imagined the Indian en- 
counters. The other might be thinking of the rough, lawless life of the 
early mining community, wondering why people would leave the com- 
forts of civilization to live in such trying conditions. In terms of the 
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course of study, both were engaged in the same learning activity but 
each was having a different experience and to that extent was learning 
something different. This kind of analysis led to the adoption of the 
term ^learning experience" to refer to the reactions of the student in 
the situation. In 1936, Dewey's book on Educalion and Experience 
clarified this concept further by emphasizing the notion that **experi- 
oiice'' involves the interaction of the individual with the situation. 
This interaction involves some mutual effects, the individual modifying 
his reactions in terms of the demands of the situation and he also 
modifying the situation through his reaction to it. Today, almost all 
curriculum writers use the term "learning experience'* and they seek to 
plan the learning situation so as to give direction to the experience the 
student has, that is, to his internal perception of the situation and his 
own interaction with it. 'l itis requires consideration of what the learner 
brings to the situation, what it will mean to him, how he is likely to 
respond to it mentally, emotionally and iu action. 

Beginning with James and Thorndike and exercising increasing 
influence in recent years is the conception of the learning situation as 
one which should provide luc certain essential conditions of learning. 
Thorndike's earlier work emphasised two conditions — exercise and affect. 
Current curriculum guides mention such conditions as motivation, op- 
portunity for practice, guidance of desired behavior, provision of satis- 
faction when desired behavior is elicited, and the like. Hence, some of 
the current courses of study are pointing out iJie need to consider iJiese 
conditions in selee'inj? the learning experiences for a particular class 
group from a larger list of suggested ones. 

A sec ond marked change in learning experiences can be found in 
their range. Although the Floyd movement had influenced forward- 
looking American schtK>ls in the late 1800's to introduce manual training, 
not as vocational training' but as a means of **learning through the 
hands/* most of the learning exercise? employed at the turn of the 
century were verbal ones. Listening a'ld reciting, reading and writing 
represented the wsiys of learning the **academic subjects,*' except for 
tile laboratory periods in high school science. Even the laboratory 
exercises were heavily verbal, with detailed instructions in the manual 
find a f»)riiial plan for writing up each "experiment." Map work in 
geography and field work in hi* ' ry were strongly recommended by 
the writers of the peri(»d from 19' ^>15, Most courses of study advised 
having children make tiiaps and locate points of geographic interest on 
them. At this time, too, high school botany courses typically re<juired 
the student to collect and identify fifty or more plants. 
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F^y 1910, high sr:hool agriculture was widely ofTered in rural areas. 
These were first courses to intrmiuce the project, or **slude!it initialed'* 
(?nl<?rprise, which, it was hoped, would help him to understand and to 
apply th«J knowledge he was gaining in the course. The use of projects 
spread to other lields and to the elementary school, thus providing a 
niueh wider range of learning experiences than schools had commonly 
used. The writers who urged the introduction of projects conceived of 
Uieni as involving a range of experiences as broad ;is life itself, but in the 
actual use of projects in the schools, activities involving the construction 
of objects have been predominant. Many teachers think of a project 
as making, growing, or producing some physical object. The extended 
irKjuiry w hich Dewey thought had largest potentiahties as an educa- 
tional pn)j(M-t is rarely found. The intellectual learning experiences are 
rre(|uently (juite minor to the physical ninnipalations required to com- 
plcle a '*c(>nstructi(>n proj^'ct.'* 

During Ihe depression, with its great reduction in opportunities for 
rennineralive work for youth, .many secondary school leaders recom- 
mended the addition of work experienct^ to the high school program. 
Altinjiigh only a small minority of high schools introduced work ex- 
perience as part of the cnmcnlnm» sonii; developed well-plauned pro- 
;;ran»s which involved using a wide vari(^ty of work aetivities as means 
for attaining educational objeelivcs related to scienee» social studies, 
rnatlif rnalics and I'^nglish as well as vocational fiekls. 

Tih- greatest impetus to extending the range of learning experiences 
has been \\u* Veclinoh)gical dcvelopnients in conununicalion. Lantern 
slides wj're in use at the turn of the century but were not found in many 
schools. At best they served only to extend the number of piclnrcs 
which cotild be employed, to add concreteness» or to give variety to 
the teaclier^s presentation. The perfection of the motion picture, liow- 
(»ver» made it possible tt) analyze movements, to show time and space 
n-lationsliips nuieli more graphically and to incr(»ase the sense of reality 
in dealing with many subject Is which refjuire vicarious treatment. The 
.iddilion the sound track heightened the sense of reality and added 
another (iimtMision of analysis. The sonnd-slido film gave some of the 
featiu'csMf the soniul motion picture in a more economical form, but it 
lacked the distinctive assets of motion. Tin; televisi()n set made possible 
instantaneons viewing of events in a fashion much like tbt nu)tion 
picture hut with a further sense of tlu* reality of the event, due to the 
viewer realizing that it i.s taking plac(» at the same time he is seeing it. 
These leehnologi<:al dev< lopmenls have gone far in removing the physical 
limitations to providing as wide a range of h*arning experiences in the 
sch(M)| as those of life ontsidi*. Mut nuieli of the coniprehetisive. ellective 
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i-lopnjrfjt t»f thfse polt rilialitRS lies ahcijd. They still n-preserit a 
^iiiall ix r i rut i,f llh- h arriin;,' experiences provi(J»*<l by Ani«Ti<*an sc}n>(ils. 

Tlif of learning experiences so as to provide for ir iivicjual 

<li!r« r» » ^ ;tiiiuij;: students is another respect in wliich clian;:es liav** 
hikt II pl;i» »- irj the last fifty years. AtttTition to individual diir»Tertees 
iM> I N-n j( crntiiated by tv\o factors: the p>.ycholo;,'ical studies whieli 
id^ iitilird th»- e\t»-nt of dilFen-nces arnon;: sch(x>ls. arnorjg classes 
iiid .irrii,iiL' studrnts in th»- sarjie class: and th»- increas^'d visibility of 
indiv idti.d ilitl'en rirrs bron^rht aboirt l>y the enrollrnenl in the s^*h(K>l 
*.r I ^ildn li li<»ni h»*ti roL'< fn*oirs ethnie ^'onps .Uid s<M*i.'il classes. There 
I I* {i \s h ;m hrrs rinv\ \vh<» fail tn rero^'niz** a variety (*f diilereru <*.s arnoii'T 
j|?r udi lil^ ill llhir(i:is>(>, diirer»Tiees vluMi in It Tests. nu-anin;;s. 

. llnfK ■ii-il itiwi'^ in *rh<»ui n(jrk. 

I '.pir.jl drvin-, ti pru\ id<* fur (lil1'<T»*nrrs arncwi;: stndiTils have in- 
vol\. i| Mhip'jil iun-. i'' tirnr ^'ivi*!i f(?r eornplelin^' If irniii;: i*\rr(isrs. 
(.r \.iri;ili<»r:> in tl*(,* r\rrri>i*s tlr»Tn>»'|\ rs. or both, i he tir^t l\pe of 
;id.tp? i»l i< III n><jii:ri sa plan for >tndfnts to \Mnk at \ aryin;,' rat^s. Arnoni: 
> d''\ • ioprnrnts wcrt* thr Sari I'raneiseo. I);jll(jn eiid \\ innrtka 
pl:ir!>. iili nf which invoKrd < »r^'ani/in;; Ihr si*h(>ol du into tv\o parts, 
oiir j(.r ;.'riMjp artivjJy and thi* othrr for individual \V(jrk. Th»*Sf plan^ 
M qiiirrd iMr d<'VfInpiM**nt of a series ol' ;i>-;ii:nfru*iits with j'nil diree- 
I it .f :> ni! p.jprr ^o tli.-it Mie st udeiits eonid w ork ;; s individuids on dilferent 
,i'«'.i;:rinn-nl'^ ;ir the sarn** tinie. As a shrdrnl t<M>k an assi^rnnient it 
b* rifrtM* his '*( I >iitraet" \\hi» li he nndertook to linish l>e|ore h*,* ueiit or; 
wjlli artotle r ;i'«>:;.''nn: -rit in the same held. Me rni^^ht. Iherefore. coni- 
jilt ic hi> a-^-^ijririirnt niuch earlier or rmjrh later than the avera;:e. 

\(j.«;>l,il ii ai- tii' the je.trriiri;: e\j)erien(*fs (herasflves weie first fo jnd 
ill ronr-^e^ (il ;t|\ w fii< li rnarki'd some of the e\eicises as those to he 
I* <piifed ni' .lii sttident> u'd <jtheis as o[>tiorial for tiie lietter stnde.itx. 
\\\ I'M .">. thi^ w .i> (*i,niriii*ri .nrion;r \rrieriran srhools. I»y l*.^-'). a inrnd)<T 
ol't itii -* h.ii| iritro<|(ired "ahilit y j^'roupin;:"' in whreli the CiMirse i f st nd > 
\'. (litVei , rit iiittd i[i >Mrh helds :j> re;jdin;r and inithrnelre into threj* 

I' thr -^MlHrior. the ;t\ri;i;;r .ind Mie nIdW sei tions. I'hi'Se three 

I i .. s uf ^tudy dilfered . ii the time j)rovided for learning; exereises and 
ii» .1 \>-^^rr in tiie ii.itme of Mil- e\er< iM*v,, In reaiiiii^'. the amount 

itt riKiferi.d dralin;; with per>ori:d .'ind so'ci.d aetivities of rhildren v\a> 
^n .iJer in the ^low sections, while the adnit material was ;,'reiiler ::i the 
>i;p' iinr >eeti<,ii^. f:i arithmetic, more concrete uiijerts were (onnted 
,11 ti ( ifiMpar.'d in tlie >lo\\ sections than in tin* oihers. 

I \\f u>e of individual projects was also a means of adapting to the 
iiidivido^d student's interest and ability. 'Ihis was recotnaiended in 
<nuisrs of stiuly as early as jOIT). I.earniu;,' e\» rcises carried out by 



TKSTINr; PKOBLKMS 



89 



small •rroiip'S twjj to tm studtMit*.' wrre lirst friipl(i\ «'<i in thi' latr ISOO'jj 
to (ofiifM-fi^at*- f»»r in;t<]f>{uat«' lalxjr;W.oiy »'<jiiifjrin'nt. 'IIm- app.iniliis 
iii-Mlltrimt to prnviii*- opportiiiiil y for < V!Ty student workin;: in<Ii- 
vi«lf]:.lj> l«j lari^ o.it th^- ax>ii:iiiiM-rit . liy IM:>0. >rnall ^Toup project- 
1m iiiLT u^ftl l)v fii;in\ t '.«)ols as a jnuria^rrablt.' nn-arrs of providing: 
r«i[ irnliv iflij.il (l!'f»-p n<f I ll** projrrts 'iifftis^-K rs c(inM dillrT in 
rii:in' *A' tli* ir iri.'»-i!r( I iiit 1 drrfiayuls aaJ O.r <livi-in»i (jf Jaljoi ariKJiii: liu' 
^hn!' iits in tl -fnall ;:roup r*>uU\ adapt • •jrtla-r t(j \\r .i " ''-^ and 
iii(«r»sr> of tin- iinlividiud. I iirurtuiiat**! y. all too (»}'« • -N^wtst 
liM[f)<r witN u'i\*'n sonj' handwork Nvliicli involvrd li / urw 

iiininwis. Ii> i^hrK with tia- ,oijl»liratiori of p--f, i-ili on \\,r . ^olo^ry 
».f ^ni;tll :.MMnp-. rdnt ; 1 1 inn.il '.vritfi^ wrn rcr; .mmmdin;: tin- iis»» of 
Muall ;/n»(jp projt rts a rn^-an^^ of lifi;:}:(f r'ia;: motivation and in- 
t-ffuMU'^ amount of m.;iniiiuf»j' Ir.ir^Mn^.' arfivity. Since thi- 
aftriiiioM of .-^la' alioiMi l.';id»-r^ f<j4 ir.M n^asin'riy on flie "•dn- 
r;ilio[j of Wir ^ift.'d s! nt ' '|*liis has hd to miphasi/in;: icarnin^^ 

♦ \[M - irnrr^ uhirh rvijiiir'- ^i*-,i]i-r ixtaadi:^;:. or skill, or t-iforl than 
tfi«-»' n-.Mally fjrovidt-d in th.- ro»if^f t.f shaiy. .U has .d>o ^tjiimlatrd 
-♦Mill* ^< hooU V) dfvt'lop h it f ir!L^ rxpt-rit-n; r- tiia* ran W rarri»*d '»n 

i •idfpniiiKii; work. 

'Wir n>osf typiral dr\ .h .pmrf t m tl:r p.;>t Iwrnty \rars found in 
r»nir-f^ I " sjjM.'y i(t pro\ id»' for iiidiv ida'-l -iiirt rt-nrf^ si;ir» hrt-n tht* ii^rrn^^ 
of .1 l,jr:„'*- iMifjih* I" of aj;_'i-M -(* d jr irr;in;^ < \pt ri<*nrts fr<»m whi^ h a ;.Nvi*n 
t»-.n hrr u*:i\ J ' '>,•"< p.M tjrnhiriy appiopriate for his cla-.- as a wlioif 
i.r f«'r u-iotjps Ml iftd? V idn.ds wiifiin »ln- rla>-,. 'i'hr (jnifo;m ifs^oii plan 
^o roairii 1 wh.'ii I st.:rt.-d \n a.-ji \^ .dirio-^t miknn'.vn now. Mo^t 

♦ Miit itliim -i.'idfN ii rliid'- a (ii-cti-si' rit of ho.\ t<» M-lfrt from anioiiir tlir 
l.»f laaid » I t.f i. ai jiiiil: ♦ :k fs sii;^-. ; sN d in th«- <'onr<«' of study 
ih'»s. \\\.[,'. .or iikr'U t(» l.i- f.'p.si -jj.*;!;*' Tor sliah-nls v.ith \ar>in^^ 
I . M K « iinds ;ni<.' ahilil i« s. 

lfii|.< I I !'t ♦dijf i' iMal o|,ji » ti \ i-s invoK <• pal tmis of hrijavior of surh 
. ..nif)l« \i' ^ lh.«t li..^ i'aii h»- <h'V* h>p«'d oidy ^'r:idnally ovrr ronsifh-rahh' 
pniods ..f tirri". I" or ♦•\.inipl»'. !|m' ahility to rntd rritically and lo inake 
tMiiipohtiiviw if.Mf pof .1* i« III- i.j vilj.jJ olit o .ids i.s ,.t-j::i:. (i li; a 

f» \\ hiii f I "l o iitidri^'aiid tli»- hiisir prinripjrs of sri^ firr and to 

Usr piiru ipK s in m.iii/ lh»- hiojo^'iraj ii'd physiral ph«'nMij,,aia 

I'Hjr.d ahoiit 11^ f«<(';!!'' a Naii»-tN (»f rrlatrd r\p»'ririM'rs ('\t«-ndin j 
ni iiiy hiiiirs. If th»' ih'\ .•|»jpnr» iit of siirh coinp! v h<*lia\ii»r palfrrn^ ;is 
th» -r ir» I' fl to isnlatrd or nnn-la t* d juTiods of h arnirii:. adiMftiat" u hi* \ 
Mail! i< iinpossihif. a major jihase in hiiildin;: a can it ulurn is to 
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wi>rk out an organization of the many, many learning experiences re- 
quired so that the student develops these complex behavior patterns 
i^nidually, day by day, and relates thern to others so as to have an 
incretisin^'ly unified understanding, and a well integrated command of 
(essential skills. 

Tho puqxrsv of (>r;,'anizirig learning experiences is to maximize the 
(•nrriuiiJlive i-ih-ci of the hirge number of learning experiences required 
to develop tornplrx ht-havior patterns. Three criteria are commonly 
forisidt-rcd as stnnd.irds to be met by a well organized curriculum, 
iianicly. rontinuity. st^pjf.'.*- and integration. Continuity refers to the 
rcilrration of tlu: desired behavior through the many learning e.xperi- 
ciiees used. Se^jueriee refers to the gradation of the learning so that each 
su.Wfjuenl exprrience not only builds on previous ones but goes beyond 
in urder to re(|nire a higher level of skill, or a broader or deeper degree 
of urulershindiri;:. Integraliori refers to the relation of what the student 
is li jirnint; in one lield to what he is learriing at about the same time in 
other lields. A broader and deeper uriderstanding is facihtated by 
ornprehending the nlation among the various eone<'pts, facts and 
prinr iples hoki'^ studied, and a more ndtHjuate rornrnand of basic skills 
is aehieved as rlie n*l Hfon of ihes«- skills to one anotIj(;r is seen. 

One surprising' fiiet hlhaiI cnrrknlum development in the last fifty 
year-r has F>t»en the lirrnt«*d attention giv(Mi lu the theory of currirulum 
orrraiii/ation. Other tlian the eo:.irJion-s<»nse lotions of thf'Se criteria 
of sue 1 1 rnle-of-tiiiirriO prirjciples as "Jearrn'ng experiences should 
proo fed frorr that which is kiuiwii Ut that which is unknown, from the 
sirrifdr to the complex, from the easy to the diifieuU.*' no new formula- 
tions have i>een made since the tirne of Ilerbart and of James. This is 
an arra < i ying for suhstarjtial theory to be tested in praetrre and to 
provide a ;:nid;^ fiir praetice. 

\t thr rrior*' ^peeilie level. develoj)rnents irj ^ ag and in the foreign 
Iarj;;ija;:es havi* been most marked. In reading, ■ (irjuily and swiuence 
arr eorfiriiordy aehrevrd tfipongh carefully eoniroll{M] v(X'abulary de- 
v* |ijpni»*nt. adding new words gradually and systernatieally. and through 
tin* eorjtrol of srnlrnee slructnr(i in the reading niat('rials. beginning 
witfi sirnj'le deelarativr sentences and moving gradually to compound 
and « oinplrx <jrii s. h.lr^r.it itjo Jm nought b(jth i>y relating Ihe reading 
matrrial to tlie common activities of the childp-n and by intnxhjern;,' 
work -type r» a(hrig in the olln suhjvv Is on a gradual basis. A similar 
selirrne of -*rt:ari'..atii/M is coinrnordy follnwvd in the foreign langtiag»'s. 

In aritljrrjf'lic. tin- d» \eh»pr/ "nt of skills is usually faeililated through 
an orgarii/atiori whieh h'^^rins witii l(Mrning (»\peri(?rices involving addi- 
tion and subtrartiui), [Uni mnltiplieatior: and division, then common 



TFCSTINC; PROBLEMS 



91 



fraclions jiikI deriiiial fni-./Muiis. No »,-\|>ii(:it sc*}if iiie of organization Cor 
ri)ii( :»*pt dt velopinent in arillimetic can be lornul in tin? current courses 
of study. 1'lie content of arithmetic problems has chanzed greatly sim o 
1000. Bt^rinning alxMit 1920. studies were made of the kinds of problems 
(ominonly cm ounNTrd by children and adults. Typically, arithmt* ' 
< oiirst s im;W onh r the problem content in terms of fre<|uenry of CKCur- 
rener of ihf pn^bh wis outside of sehcxd and in terms of the age level 
at whic h this kind of problem is rc^mmonly encouiilcrtHi by children. 

The t\pieal hi;:h sc hool ciirricnhini in niuthenialic s has changed httle 
in the past liflN y»*ars -o f;ir as organi/ation is concerned. Tenth grade 
-eotnetr\ builds littl . if at all. upon algebrii. Auvanced algebra and 
solid gforiM-try in tl >-le^gith grad»j have little st^iuential relati(jnsliip 
to tt iith uTade ;;eoni»*i ry^^Kd trigonometry in the twelfth grade does 
provide ;i elear -.rcpience for the eleventh grade work. The s^x alled 
• nnKJrrn math' rnati. s program" which is now getting under way with 
the sponsorship j>f thf njathematical organizations should provide a 
miieh bt tti • org;iiii/ed rijrri< nluni for high sch(x>l Hjathcmalics. 

lit org;inizing the s»*-called content iields, like the' sciences and the 
>.Hiil ^tudi'-s major attt ntif^n has been givt-n to the ordering of conl<*nt 
rathrr than In liitvit^r. At tfu* bepnning of this (vntnry s<*ience was not 
i.)mnio!il> t;»u^r|,| ;„ ih,. rienientiiry s<h<M»K while in the higli school 
bolan> w;>> u\n>\ Irrfpiriitly t^tlend in the tenth grad*\ physics in the 
rirvnith and elirinislry in the twelfth. By 1920. general science was 
./Vrrrd ji> th»* intrrxliK torv ><rit n( c (durs** in mure than one-fourth ol 
tlir high s» htH)I> and now it is taught in a! .osl all s< ho<>ls in the eighlli 
or ninth grade, with fa<»logy in the tenth and f)hysies and chemistry, 
whrr*' othrecj, being plared in ih** eleventh or tweiith grad»*s. The 
content of ^^eiirral ^» i»*Mce i". usually selected tf> relate to the scienlilic 
pienoirnTia most »v»rinnonIy observed by cliii(j;en. The content of 
biolo;:\ i- uMi dly « aoM'u to explain the human b*Kly, the maintenance 
of health and the roiiservation of natural resources. The organizing 
liotion h»rc is to begin with pheuonn ria which are common in the 
studriii s euvironni.nt and in which he is likely to he interested. Ihe 
advaiued s ienci* cour^.-s. [)liy«.ics and chenii>lry. deal with ihe mc^re 
abstrat t principles, whii h are thou;:ht to he less common aiul more 
dillicidt. *l he ' .'ani/atioii of tlioe two courso has not greatly hanged 
ia tie- r»a^t lil'tN >ears. I li» se illu>l rations in like h id (»f sc ience indii ate 
the atle?irin!i ;;ivi-n lo • )i::ani/iiij: the rnutent dealt with in the I .frnihi; 
evpi'rierice>. but no similar elFort ha> been rnade to op,: ui/e the behavior, 
that In, the skills atid ablhties to be developed. 

T^is is aUo true for the s«k i .1 -tfalies. Th** chaiiu'es takiri^' f»Ia( e in 
their orgaiji/ation have been chan^'es in the orderirig of content. Ihe 
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iijo>t amininii .stijufiicc of (-(jntt'iU in the sociiil .sti«dii?s is to hr/in 
thr roiiiinr;nit y. tli<ii the stale, then iIk* nation. ;ind llii.illy ;Im- \\oiI(J. 
'lljin» is litr|.» cvidrnie lo indicate* that this is scfiiieiitial in tenn.s of 
(hlhciihy in hM[niri^\ 

'Ihijs f;ir. \\r havf h(M.-ri revii; .vin;,^ the continuity and srcjuence of 
Iianiiti;:' f\|).Ticnccs in iUr conti-nt fields. The problem fjf HJle;rrati<iti. 
tliMt is. Iiow to n-hili- h-arnin^' e\j)«Ti<*nees so as lo aid the student in 
>rr\u'^ \hr n iatioiis h< t\\»M n what h. is harnin'ir i» one hild with what 
lit* i> lr;irhii)«: in am^tlM-;. has Lern attacked most commoidy tlirou;.'h 
ihaii;;f> in tin- stnieture of the eurrieuhiin. In 1900. tiie elein<*ntar> 
Ni lnHil rnniciiiun] w;is eoni|)os»'d of trn or more spceilie snhjcj-ts lik<* 
n-adin::. writin;;. sp.-iliiii:. arithnii-tir. «:«'(j-raphy, liist(jr>. natnn* >(ud>. 
h\;,'irnr. naj^^ic. drawing,'. Now. the tNpical courN* of study ineliidrs 
p;idin;; and thf l;ni;:ua;:. arts, aritlinictie. si'ienei*. lint* arts. h»'allh. 
I his rr<iijrli«,ii ]u nurrdn-r (»f suhjcets has been aeeoni|jlisln-d Ij> 
hnildir^- ;» rnort' t lo>» l\ r» |:tlrd srrit-s of Icarnitj;; <-\pciirnees in lan;.'na;:<-. 
in w}ii. h n-adi:'-:. writi-i'; i- .1 sfx iiiri;:: ;irc irivolved: iti Mxial slndirs. 
ufMif .,-/;i],|iy and history an- ititi-rrciatf d : and in tlir linr art^. 
%'h''r»- n;n>ic. dr.iwiti;:. ;ind painting: an- hron;,'lit to;;<-llM-r. 

Ifi fl.f i.iL'h ^i li M)!. thf- broad liclds of I']ri;,dish, niathrinati(-s. srimci-. 
-x : a 'hidi.-. fon ii:n l.in'rna;;*- and line arts liaVe IV»-(pn*ntly r(-plae*-d 
f .->f -jM f ili<- Nijbjt-< ts. and in >oni(.- r;is(-s thf «'ore eurii< uhirn has be»-n 
'i« v ♦■!« »|.. d wfjirii {»io\iih-s a lar;;*- >* i'n*-t nrr for h-;jrnin;; «-\pi-ri(-[i(-»-s 
,*h.il < tjp\ .'Vf n onr-tbird to tJin-iiair of tin- hi;;li srhool >tu(h-rit\ 
d-j\. >:t^^ r th '^i- l,ii;;rr strJicturrs arr usually phuinrc a^ roinsr-^ tatlp; 
flian >»\rr;il ^^-|> -atr ^ub-coursi's. thrn* i> opporlauitv iur bt-tttT in- 
t'<;:r;i}it>n. Tvpii^dK. bout-v.-r. t!a- only principh' of int»-;;ralion whirh 
Ims iH i-r> J \p!.-,.d is to brin;; lo^'t-thrr the cotilrnt ati<l skills ni-rd.d to 
d' d ..till f-ach till- stndrnt "probN-ins** wbifli providr basir units of 
(Ih- i'/'Ms-. n prnu iph* does not alwa\s {)rovi(br foi" tie- ut-ri-ssMrv 
(■ontin.at r,.. w. nor for all of tin- more la-lpful n-lationships 

ann."'_' tin- lii hi- v. ,i li . ir iir. '*lvfd. In tniniy eas<-s. a parti( ul.tr ()rr)bh-m 
r.\t»lvr- kno^^^lt. , >| J;;, i'n ti: rtain li< l<ls in otiN a rninf)r (h-^'n-<- 
■»')d o urn ^M^'L. \\u- aior.- si^^idiiranl way< In whij-li thrsr lif-Ms arr 
,t,.|. 

\t i-s \ i.iir aft • r» iniin;: tie- w*.r)i^ (<f cu/rir: Jim' lln-ot i-sts and r\;iinin' 
-fiui^.-s nf ^ 'i]d\ !/■ tie- pas' t fty yrar-^ li.iw- nut li. <-[j a tiinr ai' 
• nivl'.'nrnrnf m '\ir or-ani/a lor. '.\nti. / r\p,/ 1 <nr,<. In this 
r* p< « L rnrrirnluin . [;anp-s ha/*- b- ' i ^' li, is .. u. Tli.- I'an-ful. 
<>-t rn.itu fiL in the |i,.|d d* MMdn.L' is ;i diinia;: cxri ption. 

aron^,!! of int»-r»»st and st innil; 'ti(»r -i tlmu/hJ .luion;: s <•< ndiiry s<-Iij^mI 
»* • ih ts vi ho hav«* worked on the r(jnstr.n !l» of cor.- ("j/ri<*iila su'jg(»st 
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the great intellectual resources available under effective leadership to 
attack fundamentally and systematically the problem of developing 
a better organized curriculum. 

Summary 

This review of changes in the curriculum of the American schools 
during the past iifty years has touclicd several high spots, but it has 
not presented possible explanations for the kinds of changes noted. It 
is prob.ihle that many of these developments can be understood in 
terms of the tasks which the American schools were facing at these 
different periocls and the ideas prevailing in the field of psychology 
which s< h(X)l leaders found when they sought from scholars assistanct i 
attackin;? critical siliool problems. 

In the peritxl prior to World War I, the elementary school was steadily 
growing to include a larger per cent of the children of age 6 to 11. The 
rriticaftask was to teach the 3 K's to children of immigrant parents 
and those from the working classes. This rt^inired a re-examination of 
the |)sy( hology of reading and arithmetic, for the nsual background of 
inlenst in and experience with laiiguag*- and children's stories could 
not be tak.Mi for granted, nor eou'd earl> experiences with number 
c oncepts in the home be assumed for all children. It is not surprising 
that in this peritxi long lists of specilic objectives for these subjects 
were worked out and that special attention was given U) children's 
interests and abilities in devising harnin- experiences. 

World War f ushered in a iifteen-year period when the economy 
developed rapidly and workers were in demand. No wonder that job 
analyses and (itlier forms of analyses of stn ial life were used to identify 
more del'iiiteK the demands which the individual would be expected 
to n\rr\ and to use tliis ^*niu r in setting olijeetives From 1<J30 until 
World War II, the giv;il d»'pre-;si<)n in<Meased rather than decreased 
the mnnber of ynuth lu S4 Imul because mi the lindted opportuiiities for 
eniFdoyment. IWit i\ui Siime limitations in ^.)bs made the analysis of 
s(Mial demands a U'ss relevant s(»urce for educational objectives than 
a study nf yontlj tiicmselves to find needs and poter>tialil ies that might 
jn.sl.fy educational elfort when no great s(w ial demand was appap nt. 
Thi . periiKl alsi) was a dill . nit time for many se("ondary scIukJs because 
yoiMh .s..v\ i.o fiiMire and Ir.ie -o irtieVes! in d"f^'rre'i ednealional vrines. 
In their e\rs M'lwKil work had to be justified immediately in In.n.. of 
its interest arid meaning lo them. Hence, ihe devising of ie;irning .\\- 
periences of irmnediate interest and relevanee lo stuch nts and theii" 
organization around student pniblerns helped to nie^f ilns pressing 
problem. 



9X 



1936 IN VITATIONAL riOM'ljnEXCi: 



Since World War II, Hit' insatiaLle demaiid for tedinically trained 
peopl<» has f(xjus<?d attention on the opinions of subject experts as a 
source of objectives and has given greater ernphuMs to knowledge and 
skills. The current d<'niand for highly competent professionals and 
technicians has increased the interest of the scIkxjIs in the education 
i/i ^Nftt^i children and in devising a better orpinized curriculum to reach 
high levels of achievement. The shortage of teachers has furthered the 
demand for technological devites that increase the runge of learning 
experiences, such as television and the sound motion picture. 

Throughout the filty years, the s<'h«jols have been pressrfl by con- 
tinuing conditions >vhi(!h create crilicid problems that cannot be solved 
withtnit further curricidtim developments. The first of thes^? is the rapid 
change in technoloi^Mcal development and social life >vhi< h n.^jnires a 
continually increasing level oi' education oi\ the part of our people. The 
second is the inci^asin- pn>fKjrtion of children and y<julh who an* 'nt 
lo the schools Tor education. The third is the dislocation in other 'v.u- 
cational insfitufions, the home, the church, the neighborhood ^ lich 
rapid swial change has eng.'ndered. The educational needs of tofJay 
and the imnif r;;.?,.. future are greater than ever before. American educa- 
tion has done :w, anja/ing job in getting ahn(*st all children and youth 
in s(h(K*l and providing sclu)<)ls fur this immense number. The schools 
havf been asloundifigly Mt/ressful in building confid , on the part 
of the puhli(r in tl- • • Mnabil't; of tducation in building onr civilization. 
I he t.int^ has i:,;,v= i, rrcogni/<* re;.h'stically the magnitude; 

of the job, io U\cir,f , V , . j.vrive- shich thes4:h(xjls can best attain, 
lo encourage the lii-f-,; ir, • tinn h and other institutions to undertake 
the tasks ap\ • d» vis<' learning experiences clearly 

relevant to the : f)ropvi ohj-M livrs and to work out an (jrgani/a- 

'i.:n of the curricnhnn which aids the M-deiils in attaining a high level 
uf atii>n;d competence, 'iliese steps :ll aljead of iis. 
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New Kinds of Students and 
New Ways of Testing Achievement 

LO I IS M . 11 A C K K W 



I 

I should prt'fer to tiilk Lir-r^'ly of some of the impressive problems that 
are to confront us in the iinmi-diate future rather thar? (^ur shortcomings 
in the past. I can view both from the vantage point I occupy as an edu- 
cator, associated as I am with a somewhat unique institution. The School 
of General Studies of Columbia University is an outgrowth of its Ex- 
tension Division, whi; h was tvstabll.hed more than 50 years ago. Seeking 
to rench adults with a program of broadly cultural and narrowly vc^ a- 
tional and te( hnical subjectri— and patterned after the Workers Educa- 
tion Asswiation and I niversity extramural tutorial schemes of Great 
Britain— up to less than 10 years ago, this supplement to formal edu- 
cation at Columbia University readied a large atidience in an urban 
(•(nnmiinity. (liven almost exclusively in the evening, its lecVjrers for 
the lar-tT part from th(» University's own stalT. the prorrom mainly 
w'riA a iion-<re(lit one. although a few hardy individui»is by persevering 
through its miscellany of e(jurses could put together a colnTcnt eiir- 
'rulnm to (*btain a dejiree. 

[n 1918. the School of General Studies was establisiied to grant an 
tindergradua**^ degree but it did tmA snrrrndr'- its association with its 
partirnlar sr^* h-nt eoniinunity, '-^lat is to say, ^:dult inei. and women 
who cotN*: I'-^Jend furin;il studies only as part-time students either 
beean.se l y were fully ^ niploya or because they were liousewives. 
Those wh(» 'vere .s( ('king fM;«lrieuialion were n^piired to take an aptitude 
examinali -ercraoy sinular to that of the College Entrance Examina- 
tion Hoi.ni. Those wfio had nn high school diploma or its r juivalejit, 
following the aptitude examination, were pcrmittwl to matriculate - 
without Comiilions or defu imeies— upon the successful completion ol 
ii so-vaI^ d \ alidation Program c asistiiig of the following 5 subjeels. 
each for one semester: inatl. tThiJi- s. history, I'Jiglish. a foreign language, 
and ehemistry or physics )gy. !n order to protect the program, 

non-cn-di? . nurses of a viH'ational .w:re dropped and every course 

olTered had to be under Mie .i^jspi^NS of a (ic^partnieut of rli,; University. 

To encourair^' these students many of ^{«' ni removMi In n; classroom 
rxperii'Tices and therefore formal L-arning for a> in, my as '10 years or 
more, the status (»fnon-n» triculated student was ; r-rvied. \:sy person - 
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with a h\<rh schrxA diploma or its wjijivul<,'iit -could tnkt- up to 9 points 
;j seirH-.stfT without the Aptitude T<*st : in short, iidults sffking a serious 
fdijc.'jtion were ptTinitted to test Mieir capacities in the classroom. If 
thf (:otJrs»-s for which they were i-tirolled were t;lemeritiiry ones, they 
could re^^istt-r v\ithoiJt furtiier ado; if they were ndvanced, prereifuisites 
h.ul to be s.'Jlished (»r the instructor coiiviiieed (jf their ability to go ahead 
on the bnsis of Irainin;: in or out of the cl'iivsrooni. 

This was ;j bold stcf). arid to ft • K fculty of General Studies con- 
tinues committed. It is based on ihr assumption that older persons 
should somt'where have the ii«cht- \u the classro<jm itself— to find out 
whrfher they carj train their mincN for fornkal learning. It also is pre- 
p:ire(J to r»'co;;nize that such peof)Ie rrc(|uently art* tiniid about e.xposing 
themse lves immediately to entrance examinations or embarking upon 
an onh'riv fiivk'nura of studi.vs nf the kind we find in the characteristic 
lirsl-year .-Al -jf jrani. that is. I'ji^^li.sh, history, mathematics, a 
forei:;!, l;,if-,i.i;:e. a ialM»ratory seieiicf. We have found that many older 
persons w^.ijjd like to try l.rst the suhji-cts they are already familiar 
with as a result of rcadiii;:, or other experiences; in const^juence, they 
:irr likely to concentrate in literature r>r history or mathematics or a 
j'irei;.'n lanj:ua^'e. As non-matriculatcd siudenls they can do so, so that 
eofifirlrnr, is built Up. e\p(Kiire to cla> room pnxx'dures takes place, and 
rtuiiilies fur eoun.vlliri;; -by ie;irhers or advisers — present theni- 
st'lves. A shwlrnt can eontinue under tliis non-matriculatcd status for as 
nia/iy a^ *H} pniuls; a few of them — older women in particular— wait 
t; it Inui: lirfore furnially i":(erin;: for defrrcc candidacy. Hundreds of 
>^ijrh peoplr r;irh >r:ir are >liiv\ly led (unn non-rnatriculated to matricu- 
lated status. In fart i '' rl,,. MOO matriculated students in the School 
erirollrd ihis v\inttT >rh,. ^ler. almost .'jO percrut starte(J their educations 
i » tin* Srhnol itself as n<»fi-matrirulati'(l students. 

Incrrasj'ii;;ly. therefore, thr Sehocjl'.s .llOO n(ui-inatriculated students 
art' tlie >(niu't^ from whrrh its loiatrieulated students are obtained. I< 
should nnt be assunird tfiat all of these have had no previous colle^riaie 
exp»rienrr. At ]e;i>t JO prr ernt are already undergraduate de^rree 
Imldcrs. lakin;: cnursrs or prn-rauis tu e(»niplet(» their preparations i'nr 
•/rnduiite sludy or brcrmsf they wish lu makr* up subjects for entrance 
lo f)roli >,>j'',ti;i| srhiiols. S<inie are on probation 1)- < ause of previous 
lailiire or academic su.|M'n>ion. Mut ihe "casual" student, just taking 
a cour-'. i:: proc» of (lisapf)earing. The non-matricuhued student 
in thi'S li. h:fs hn .fn.' ;i pp' iTiatrieulant looking forward ultimately 
(o .1 Ti'L jlar degrer pro;:ra:n. 

Here ;ire risks, nutnnilly. in thrse procedures: for non-matriculated 
nd ij; 'ririilaled stu<l. .nf not se;;regated in the classrooms aiifl - 
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with sijrli :i lirtrro;;*'rirotis ^tndfiil iMxiy—lhcn* is Ih^ (limj^cr of lowering' 
standards. Thc^r can hi- piotcclt'd only by Iht* m(jst rigorous classroom 
rontnjis: siii;ill f l;iss<*s. fmpirnt exaininations, highly competent iii- 
>trii( tioM. ThoM' who, it is p«T(*»'ived within the first few weeks, simply 
("iiinot luukr the gni(h* are fffjin'sted lo drop out with full tuition 
n funds: om- who hill nre (h ni»'d n-registralion. Malrieuhited students 
arr closely ti-strd at thr rnd of tlh'ir (h'gree programs, for each student 
must tak»ja inajnr and that cannot Im; completed or graduation aeliifved 
without a d»-[)artniental eomjirehensivr rxamination which is written 
or (jral or iuWh. 

I havr said that th»' ^' hool's Faculty is opposed to the general use 
of pirliiniijar\ ♦•viirniriaJ'.nn for ioursr admission— in fact, only in one 
'Mil)jrct is a |)l.i» . inriit trsl t^nplo>fd and that is for rlcmeutary English 
comf)ositiori. This wii't r snnn* lOO persons took this test and about 
10 per < rill (;!il< (i it, Tln se latter were put in Ivnglisli cAl, a remedial 
rourse in ri)fii[M)^ifi»)n. ur r.n^rlish a remedial coarse in reading liabi*^ 
and study skills, livr- l'.ngli>h e\j kerps the door oim-u: i\)T those n- 
cjMving a gr:ii of li - or better obtain credit Mnd are exempt fron. 
I':m:li>h AL 

'I'lie School's {■ acuity is persuaded in its course as a result of its 
evperiences. onl\ are I;irg*'r and larger nundjrTs of persons success- 
fully completing courses of their own selection- souietimes over as 
many as or (> \ears and then beroming matriculated. In addition, as 
many as 60 to 70 per emt of the graduates each year enter at once 
further studies in professiorj.d and graduate r-chools. lb-re. Ix'fore ad- 
mission, most of them are formall> tested by admitting unices; and their 
entrauie and subsej|Uent sueri-v>es support the convielion that the 
School's edijciiliona! >tan(l;u-ds ha\e not bi-efi lowered or hnrmed ijy 
its o[)en-door ;nhui-.>ions juiiies. 

This (j()e> nut irnfiK th>t the Selii.ul is not constantly seeking (jbjeetive 
an«I comp;u-if is e nieasuiements of [lerfoiina nee. rolundjia I niversity 
h,i- two »)ther ondergradiiate instiltitions Columbia ('.olle;:e for boys 
:ind P.arnard ( ".olleLN' for girls. TIu n. like tlir School of (Jeneral Studie>, 
have the major ss^teiu. Meeent!>. I insited the deans r)f the rjther two 
h IiooIs f > establish with us a ( innmon eompreliensive examination In 
•aril dep.utrni-nl -rantin- a ciajor for the testing -and graduation 
uf the three student Im-.);- < ur(drr sitnilar auspices. 1 was i)r(Hni)ted to 
do >o as a resoll of I'-r-ori.iI experiences with the ()\lord Colleges. 
There :ir.- at ( M'ord I laM-r-its. >nrne 2M-odd un(h ■ ■radtiate colh»ges. 
each of whieh has it- own adinioions pohcy and ■ > own iustnn'ti(m. 
r»ut ea'h >Iud<'iit am-t em'oll iit an Honors Sch- lol -the ecpiivalent of 
our major nul the end tak-- >' ries of examinations set ihjI by bis 
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own instructors hut by the Faculty in which he is enrolled. Graduation 
(hpoiids upon the successful cumpletioii of these examinations; con- 
sideration is given to no other fectors. 

I am saying, in consef}uence, that as far as older students at any rate 
are ccjnceriied, one of the significant ways of measuring achievement 
has very little to do with the customary testing devices. Sympathy for 
the problems of swch s iJcnts as they embark np(jn — or resume after 
Itjiig periods of (ii.s<^()iitinwity — the formal prcx essi's of learning; a wilHng- 
ncss t(j (iisn»gar(i. from tinje to time, initial t<?st sccjres; the refusal to 
insist nfxjn adhrn-n( to a rig(jr(jus pattern of se(juential studies — ^these 
attihides iiavr \vd ti» the uttinuite siilvaging of what turn out to be very 
g<KKi and not irifrecjnt'ntlN excellent minds. For. in the School of General 
Studies, We have seen thousands of men and women — who never had 
th(» chance vnrVu-r to begin a ( (jllegiate edtication or who failed somewhere 
else: many of whom begiii with us falteringly — not only graduate well 
but g<j ahead in professional and graduate schools to careers of great 
usefiihiess. These attitudes on our part have added a new resource to 
tin* trained nian|, Aver of the nation. Particularly in the case of women, 
wh(j wilh early marriage afid early families cannot continue education 
after high school or the' first two years of C()llege, then; is made possible 
(raining for a career at ag' 3.1 or lat(»r. When I n;mind you that the 
drop-out rate for women's (<>1 leges runs betw(,'en 23 and 50 per cent, 
and fliat tl>«' life expectancy of women at 3.*) years is more lliaii 10 years, 
then the need and possibility of resuming lla ir education given the 
proper au'^pices is one of the ini{>orlant challenges (*oufronting us, 

II 

I'll I let us turn to the immediate future. Then' is no need to rrpeat 
In this aiidierite !lie character of the education{il problem that will 
confn»nt the I tiited ."^lates within the next d(!cad(\ Not only has our 
birth rate doubled since 19 tO. and thus automatically doubled the age 
(•ohort from whi( li our undergraduate college body is drawn. The efforts 
to move into collegt' (hat significant group of high-score high scIi(K)1 
seniors who fnr f)!ie rt-.fson or anotluT currently are not attending; the 
steaclily mounting real family inc(jnie. making it p(>-sible to finance 
privatrl\ the college education of more than one cJ>iId in the family: 
f he gn»\^ iiig inter»'st off ofufKUiies and even trade unions in the establish- 
fiient of scholarships these Int vitably are t(j have large efTec^.^ (ju the 
>i/e of our college popui.ition. A( a niiriitnurn there will be a doubling, 
at a inaxinnun at least a triplirig. within the next lo years of the 
residential full-time ictiaJerjt b(Kly. 
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If to tlu'sc. v\t; add the part-tirin' older students taking formal studies 
and many of whom will also be degree candidates, then the problem 
takes on shj^^piring proportions. 

I^iblic authority— nuinidpahties. the States -under constant pres- 
sures, will seek to discharge their obi i«;at ions in the easiest and cheapest 
ways, and that is throir^^h the creation of larg« numbers of local institu- 
tions offering tw(j-year programs. The pattern already is a familvir out. 
In part suptK)rl<'d by llnr Kx'al coiimiiioily. in part by the stale, these 
community coih'ges or institutes of the .iris and applied sciences or 
junior colleges, are oll'eririg brjth terminal and lo\\;er-college programs. 
The lermin;d programs are VM-ational and end then:. The lower-college 
programs are in the librrral arts and a a' also pre-professional, e.g., 
«'lrclH«-al engini-erin.!: and mechanical engim.M'ring. 

Two probie.jis will euKrrge as a result of their (»stablisliinent on a 
g:'i!era! scale. Because they are being hjcally supported, it will be dif- 
lic.ilt to resist the demand that entrance be general and not restrictive 
on the basis of admission tests. fTln'se have been the experiences of 
ilut state universities, as we know.) I%ven if an effort is made to restrict 
(rnlrance in the purely acadc^mie division, students will be able to enroll 
in the V(K:ational division and seek transfer later, on the basis of good 
p(Tforn)ance (as they will have every right to do). 

In the second pla^;(^ what to do with tlios(j students who. linving 
conjpleled a two-year aca(h*mic or pre-engineering prog-am, have the 
desire and the eapaeil y to go ahead for. a( lirst, an A.li. or a B.S. degret; 
and later, for graduate or pntfr.ssional studies.'* Current experiences 
with these two-year programs already indicate that at least 23 per cent 
and perhnps as many as .")() per crnl of such students want to and have 
the capacity tr; foiitinut' their edu<'aliori. 

How to test the achievement of .-.todents in these two-year programs 
in orrlei- to make possil>le immediate full-time continuation, part-time 
eunlinnation ffor those who will go to work), or rh'ferred continuation 
at a laltT d >tt? v the so-called "delayed tran-jfers" as we refer to them 
in the Scho* of ( /eneral Studies).^ 

i.et us I(K)k igain at th(» cMvr. part-time students in the School of 
(i eneral Studies. Many r>f .:av;> lost a gorxl de;d of time as a result 

of discontinuity in ednca;. f"'' ;o-called **delay(fd starters" and the 

so-called "delay-d transfers constitute 66 per('(^nt of the niatricu- 

lati'd students, ha . r a median age of 30 years. "^I'licy arc, oa an average, 
l.*5 years behind in tin* completion of their education.) Every effort is 
made. ;»s i\ result, to rncourage sir-celeration : by prof("ssional option, by 
double summer sessions, l^y heavy programs (if they are full-time), and 
by cn?dit by exannn; lion. (This last, approving 30 credits by exaniina- 
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tioii in dfiiiiMjlary subjrcls. has been jidopted by llic I'aculty but as 
yet has not been accrpled by the University.) With so much time losl 
and with so lar;;.! a proportion of these older students lieadin-; toward 
advanred studies, accehMVilun is desirable and, in fact, iieeessary. 

I am. in consetpience, joining the probh'ni of the older, part-time 
siii(h-nt and ihijf of [\\r, aecredilation of the shident from (he two-year 
coininnnity (-(^ih-;:- who imniedialely, on a part-time basis, or subse- 
qiiriitly. will seek conliniiation of his education. 

For these i pmf)ose ihr rstabhshment, f(M' the /ir t tinnj in America, 
of a f^roiip of universities rt-^Morialiy Icjeated —which will take on the 
«jri^,MnaI I'imk ti(jn of the university as an exaniiniiir body. I do noi .ean 
that tlirsc iinivi'rsili<ss should be separated froii 1' leaehin^r function 
:;rui \Ur residential sludents. i am s^^'^;esting tii... ihoy add to their 
customary ac tivities tiie examination (jf— and therefore the ;:ranting of 
degrees t(j students who are taking lh(i academic and pre-professional 
sides (jf the Lwo-\ear couiuiunit y-college progranis and Uie older stu- 
dents, largely seeking acceleration, who want college degrees. 

My pro.ot>f)e. obviously, is London Lniversity. fnitially. when it 
was founded more than 100 years agr). it was wholly an examining body 
and all it-^ students were so-caHed "external" students. With this pattern 
.exehiding ONturd and Caudnidge, nainrally), l-;ngland found il possbile 
loeslabhsh its large network of uni\ -rsit y colleges tiirough thecount' y. 
Thiswaslheoti^Mti(»rthe"Hedbrick I niversity:" hjcally set up. wiietlier 
at, liirniingham. Leeds. .\ ol linghani. or elsewhere*, th»» university c(jiiege 
aduiitte(| its own students ;uid gave (hem instruction. But the degree 
was thai of l^ondon I niversity. for the (*\atninations wen* dniwn up 
and graded b> the pr(jfess(jrs and -.enior lecturers A' Lfjudon. 

Within recent \e;irs, all bid (^ne of thes(.' university co^eg^^s have 
obtained charters and heetj set up as indi'piMident universities. At the 
sjune time, within recent years. London has be(jii taking its own resi- 
dential or "internal" students. 

P>ut London cnntinues as an examining university fcjr 'cMernal 
sIudeijN. notably in tiiese three gioups: 

1. Sterients wht) cannot cstabHsh residence, either l)ecause tln^y are 
part lime or bec ui.se they elsewhere. A student s!ill can obtain a 
(iegree undergraduate, grathiat. . or prolessionaL simply by standnig 
f(ir the' examinations oll'ered by London Lniversity. No formal at- 
tendance. an\ where, is reipiired. 

2. Sludents who attend miiversity coII<-.u'< in ilie crown colonies. A 
group of su( h c(»IIe-es iu Africa, the We^; indies ha-^ beerj set up: 
hh.' the earher hiughsli university colleges, tuey an- psidential. Hut liie 
degree is that of London I niversity. 
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3. Studrnls jit Irridin*; ihu pulyle(:i3nicaJ sclinols of (jiLNiler Luiidnri 
i\nd <;lsewln'n\ I'iirse h;»ve bcrn ♦ sUihiishixl hy I(»r;il authoritifS cJImI 
are liiumccd l>y Jlii-s<?aiid not ni?t;'»Mrf''y. throij;;h (lie LiiivtTsity (iraiits 
CominitU.'»-. TIh'V Iiav«' lli<*ir u\*n litMii.ssions policies and instruction 
pr<ii;riiii\s. Tln-y startt^d out, like anr ovtn institutes of arts and aj)plied 
S(:i«*n<:f*s. to «;iv(j v(K:ationaI pro^^rains; inc'reasin«^'Iy tliey are oIlVritijL,' 
aeadrini(j and prf-prolessional and cnginecrin',' ciirrieuluins. Tlieir df- 
/^'re»'<. iiowi-ver, arr London I niv«'rsity de;,'nM:s. for tlie linal examination 
of Ihr students is llh' work of the L(»ndon i-'aculties. 

Tliese "exterriid" slud'-nts of Loruion Tniversity may tak(? instruetion 
I'rom London through ('orrespondence courses, whose* papers ai" care- 
lully read and graded. But not for degree purposes; liere. a;;ain. as at the 
( )\l(>rd and Camhridgt' eollc'^es. instruction is really coacliin:: for i'"- 
linal examinations, whieh an- the ordy bases lor de^'ree i:ran?in:r. 

IL then, a ^^rouj) iA' American imiversities. hnvitcd in -r^-.ii uihan 
comnmriitirs. take on (la? "external" dej^^ree ex;irrjin:ii • tion. in 

adihtion to the edneatiou of resid»-atial students fher-. • :r ihe 

de>«-Ioj)nieMl of Lon(h)n I niversity). shah he in a jj rci^n- 
Iar i/ -and whoHy aecre<ht tlie work of older j)art-( irJie si u ^ j<I th-W 

of tho>e in tlie two-year s^-hools on the aca(h:n:ii' at;:; prf'-r-Ml'rssion i| 



For the oI(h'r students, residence, formal curricnhin\s, .«;radi - i??:- earli 
course, a mininiimi of \2i cretUts lor graduation iic ' « ; nee'(i he re- 
ijuired. A student nia> attend or not— and it' he at Ir/". exlei'iiai" 
>tudent. it w ih hr for eoaehing purposes oidy. A tier - -r-i .\ lor "intcrnar* 
students of course, w dl '*oiitimn'; and tiiose w ho eh' a i'orrnal resid-'-ntial 
progranj slioidd Iiave tlie opportunity of (h)ing so. 

Other coaehing ai({s. for tln» *'externid" students "in(h'('d for tlie com- 
numit.y at large -might also be inchjded. I refer to correspon(ieruM; 
courses and to courses tlirough teh»vision: I1h»s(\ of course, shouhi be 
wholly forniah instead of broa(iIy cultural (as under the old Ivvteiisifin 
movr-ment). and shouhl not carry credit. 

l*'or tlu' two-year community colleges and their stii<lents. the' ad- 
van tag«'s wouid be inmiefise. The very dilli(Mjlt jiroblcm of aceredila- 
bonnd to plague these inslitntions as soon as (he (pjestion of 
transfer arises--\vill be dis[>os*Ml of. Local control over adnussjons and 
instruction can b<* maintaii)''ii iit the same lime that standards Ail! he 
sujiported and degrees made meaningful, for emf)loyinrf)r or transfer 
to higher institutions. 

Tliis is a new kinri of testing, obviously, but necessity and the aj)- 
pearanc»' of new chaHenges fnree its mnsideral ion. 1 do not ' uit to 
pH'Ss the "novelty" of the proposal too far. of cour>«': for cert iii- ation 



si<les. 




